LEXST Search Engine Application
(Lexst-SEA)
2009-7-10, Lexstpider to be independent
Lexst team decided to let Lexstspider to be an independent software, after some users reported that they sometime need save some crawled page as local files. Users would be able to download it free soon at lexst website.
Lexst-SEA is a scalable internet/intranet search engine software and an enterprise level internet and intranet search engine software.
Lexst-SEA can easily index 1,000,000,000 pages. If you have 1000 ordinary PCs, and connect them all together, Lexst-SEA can help make a huge search engine cluster. If you want to build a huge scalable search engine service, LEXST-SEA is the only option except google GSA.
Many take it for grant that a distributed search engine software is very difficult to install and mantain. But acutally Lexst-SEA is a very easy search engine software for deployment, you need only ordinary pcs, and set up the search engine infrustracture in 10 minutes. The whole search engine would be running automatically like a robot.
Similar to Google GSA,Lexst-SEA, as a search engine software, includes as many searching features as possible, besides these features and the huge scalability, Lexst-SEA has a built-in backup system, whcih has dual functions: backing up the data, and makes the searching system higher available. ... More details
Features of Lexst-SEA.
1. As search engine software, Lexst-SEA cluster can dynamically be scale from one server to 20000 Servers(nodes) very easily.
2. Distributed Data Storage and handling, will speed up the search engine performance dramatically.
3. Searching result can be returned within 0.5 second, even when the data volumn is in very huge scale.
4. Lower investment on hardwares, searching cluster can be deployed on simple PCs.
5. This search engine software can dectect the errors usually within one minutes.
6. The Search engine can replace the halted node automatically with standby nodes.
7. No worry about "run-out-of-disk-space", Lexst-sea would start an idle node to store newly generated data.
8. When too much fragments found on disk, the search engine software would clean-up all the data in that node.
9. Custmized definition of keywords: users are allowed to give different/customized meanings or explanations to existing and popular words. This feature is particular useful, because the search engine software let administrators has the ability to build their own search engine suites their industry or circles.
10. A standard spider/crawler included in the search engine software. You can control the crawler through the panel, both internet/ intranet search engine builders can tune the crawler to their needs.
11. Index the data in existing enterprise database, Lexst-sea supply the tools to help users retrive the data from their database.
LEXST-Database Cluster
LEXST-data cluster can be understood as a database clustering system, but much quicker than usual SQL database, Lexst-data cluster help you search 1 billion rows data.
Some sectors need search billion rows of data, for example, telephone companies, spare parts suppliers. These data are simply structured, SQL database system obviously can't help, beccause they are too slow to handle such a big table.
Lexst-Data Cluster partitions the big data table, and uses a quicker indexing algorithm, partitioned structured system divides and assigns the search requests to every data node. It makes the search much quicker and balances the search load.