LEXST 1.1 for Windows
last update: 10th June, 2009 ,
please find latest version of this Guide at http://www.lexst.com
Before installation
Hardware and Operation System requirement
Install Java environment Kit 6.0
Install the cluster
How to add Standby Data Node
How to add Standby User Node
How to add standby Master Node
How to add Idle Node
Automatical Partitioning
Mandatory Partitioning
Lexst-SEA is running in JAVA enviroments, make sure Java JDK6.0 has been correctly setup in your windows system.
Lexst-SEA has three parts: Spider,LexstTomcat,and Lexst-core.
LexstCore is composited by MasterNode,Log Node, User Node, Data node, Call Node, and Remote Node.
Please check the software package before installation. The package should include:
1. Lexstmasterinstall.exe
2. Lexstloginstall.exe
3. Lexstdata.exe
4. Lexstcallinstall.exe
5. Lexstuserintall.exe
6. Lexstremoteinstall.exe
7. LexstCallTomcatInstall.exe
8. LexstSpiderInstall.exePlease NOTE: Some components of the LEXSTSEA are compiled in Java script, you need to install Java JDK(6.0 or above) before running Lexst, users can download Java at website of sun, http://java.sun.com
Please avoid using default directory for JDK installation "c:\program files\java", we recommend "c:\java" or "d:\java".
Pentium IV above CPU, 512 Memory, 80G hard disk.
64 bit Windows operation system.
Install JDK 6.0(or above) in each node.
Close Virus-killer applications, if you can't close, please make sure these port numbers are not forbidden by the virus killer:
8000,8010,8020,8030,6000,7010,7020,7030,7040,9000,9100,9010,9020,9030,9040
On the server(s) chosed as the "master-node", run "Lexstmasterinstall.exe";
On the server(s) chosed as the "Log-node", run " Lexstloginstall.exe";
On the server(s) chosed as the "User-node", run " Lexstuserinstall.exe";
On the server(s) chosed as the "Data-node", run " Lexstdatainstall.exe";
On the server(s) chosed as the "webserver", run " LexstCallTomcatInstall.exe";
On the server(s) chosed as the "spider", run "LexstSpiderInstall.exe";
1. On Your Log-node:
Find "local.ini" in the directory where LogNode installed,and find the line:
master-ip=localhost
and replace "localhost" as IP address of Master Node, for example:
master-ip=192.168.0.1**Please note:if you install all nodes in one machine, you needn't change the ip address.
2.On Your User-node:
Find "local.xml" in the directory where User Node installed, and find the line:
<master-list>and <address>localhost:8000 </address>
Replace IP address and Port of your MasterNode , for example:<address>192.168.0.1:8000</address>
**Please note:if you install all nodes in one machine, you needn't change the ip address.
4. On Your Data node:
find "local.xml" in the directory where Data Node installed, and find the line:
<master-list>and <address>localhost:8000 </address>
Replace IP address and Port of your MasterNode , for example:<address>192.168.0.1:8000</address>
**Please note:if you install all nodes in one machine, you needn't change the ip address.
5. On Your web server node: run "LexstTomcatl\bin\startup.bat";
Find "local.xml" or "lexst-local.xml" in the directory where LexstTomcat Node (web server ) installed, and find the line:
<master-list>
<address>localhost:8000</address>
</master-list>Replace the localhost:8000 with the IP address of your Master Node, for example:
<master-list>
<address>192.168.0.1:8000</address>
</master-list>**Please note:if you install all nodes in one machine, you needn't change the ip address.
Then run "LexstTomcatl\bin\startup.bat";
You MUST follow steps blow to start Lexst in proper order:
1.On Your Master-node: run "lexstMaster/master.exe";
2.On Your Log-node, run "lexstLog/logsvr.exe";
3.On Your User-node: Run "lexstUser/usersvr.exe";4. On Your Data node: Run "lexstData/Datasvr.exe";
5. On Your web server node: run "LexstTomcatl\bin\startup.bat"; In your IE browser, visit the address: http://localhost:8080/search
You can see a simple webpage, where you can create database, and search it if data added in.(typically data should be added by Lexst Spider.6. If start a spider, on the server where spider installed: run "spider.exe"; After simple configuring on the spider control panel, your spider can crawl pages. For more details, please see the "help" on spider control panel.
For higher availability, you may need to add some standby nodes to prevent system halt if any erro ocurrs. In the "local.xml " file of Master node, you can see
"<user-cluster>", which specifies how many Standby user nodes allowed in the system, minimum 1.
"<Data-cluster>", which specifies how many Standby data nodes allowed in the system, minimum 1.
You can change these limits, simply replace "<Data-cluster>1</Data-cluster>" to "<Data-cluster>2</Data-cluster>",
***Note: Total Number of data nodes, user nodes, and Call nodes is controlled by the Liscense.
All Standby Nodes shall NOT be started before their primary nodes, otherwise they would be regarded as "parmiary node(s)".
1.On your new server(with JDK6.0 installed), run "LexstDataInstall.exe", install LexstData there, and configure IP address and port(of master node)correctly in the file "local.xml",
2.start the node by running "Datasvr.exe",
3.While later, the Master Node will automatically assign the new server to be a Standby of a Data Node in the cluster.
1.On your new server(with JDK6.0 installed), run "LexstUserInstall.exe", install LexstUser there, and configure IP address and port(of master node)correctly in the file "local.xml",
2.start the node by running "Usersvr.exe",
3.While later, the Master Node will automatically assign the new server to be a Standby of a User Node in the cluster.
How to Add Standby Master Node
1.On your existing Master Node(s), add following code between the <other-master> lables in local.xml file, like:
<address>192.168.0.112:8000</address>
2. On each node of your existing cluster, open the "local.xml", find section "<master-list>", add address info of your new standy master node here, for example:
<address>192.168.0.112:8000</address>
3. On your new Standy Master Node: add address info of other Master nodes into the local.xml file: for example, if the existing Master Node(s) has IP address as: 192.168.0.1 and 192.168.0.2, then you should add following:
<other-master>
<address>192.168.0.1:8000</address>
<address>192.168.0.2:8000</address>
</other-master>How to Add Idle Node
Idle Node usually is an Idle Data Nodes.
Adding idle data nodes is same as adding a standby data node, actually it's the Master Node that decides whether it can be an Idle node or a standby node.Master Node would check if each Data Node has sufficient number of standby nodes(it's specified in local.xml of the node), if yes, then the newly added node would be assigned as an "Idle" one. If not, it would be assigned as a "standby" node of a data node.
When halted node get repaired, just put it back into the cluster, usually its "standby node" has already taken the position of "primary node", the fixed one would become a standby node, communicate with its primary node, and eliminate the data difference between them.
Partitioning only takes place at Data Node(s).
If the Data Node had a limited space(for example 20G). When it is nearly full, the data node would send partitioning request to Primary Master Node. Master Node would choose and assign an Idle Data Node. Then this Idle Data Node upgrades to a Primary Data Node, and partitoning takes place without any human attendance.
Note: If there is no Idle Data Node in the cluster, partitioning can't start.(that means your whole system can't store new data). So cluster administrator should know well how your data volumn grow, and always deploys one or more Idle Data Node(s) in the cluster.
Through the Control panel of the Master Node, click "data nodes", and choose the data node need to be partitioned, and then click "Split Space", and follow the prompt to partitioning.
Please note you must have at least One idle data nodes running in the cluster before partitioning taking place.
Any Other Questions, please contact lexst.com