Logstash
The Logstash service is running on PM server. It has two pipelines:
- logstash-spa. This pipeline receives log events from all Filebeat services and puts them into /opt/workfusion/logs directory.
- logstash-automl-extract. This pipeline receives log events from running AutoML extract models and puts them into the
/opt/workfusion/vds_master/AUTOML-MASTER_HOSTNAME/automl-extractdirectory.
Service overview
| Software owner | Elasticsearch BV |
|---|---|
| Management | wfmanager (start | stop | restart | status) logstash |
| Log files | Access logs: <INSTALL_DIR>/supervisord/log/logstash.out.log |
| Startup scripts | <INSTALL_DIR>/supervisord/apps/logstash.ini <INSTALL_DIR>/logstash/bin/logstash |
| Configuration files | <INSTALL_DIR>/logstash/logstash.conf |
| Default Ports | tcp 4567 (logstash-spa) 4568 (logstash-automl-extract) |
Default parameters
| Configuration file | Name | Default Value | Description |
|---|---|---|---|
| config.yml | install_dir | /opt/workfusion | Directory to put user files, logs and configs |
Troubleshooting
Check if TCP port 4567 is available
Ports may be custom:
netstat command output
$ etstat -lntp | grep 4567
tcp6 0 0 :::4567 :::* LISTEN 23433/java
ss command output
$ ss -ltn | egrep 4567
LISTEN 0 50 :::4567 :::*
lsof command output
$ lsof -P -n -i :4567 | grep LISTEN
java 23433 wfuser 17u IPv6 117393 0t0 TCP *:4567 (LISTEN)
Check service standard logs
Output logs: <INSTALL_DIR>/supervisord/log/logstash.out.log
Error logs: <INSTALL_DIR>/supervisord/log/logstash.err.log
$ tail -f <INSTALL_DIR>/supervisord/log/logstash.err.log <INSTALL_DIR>/supervisord/log/logstash.out.log
Check logstash out (access) log using Wfmanager util
wfmanager tail logstash
Enable debug information
Set the appropriate log level to <INSTALL_DIR>/supervisord/apps/logstash.ini (default is info) and restart logstash service:
${install_dir}/supervisord/apps/logstash.ini
From:
exec bin/logstash
To:
exec bin/logstash --log.level debug
wfmanager restart logstash