9.4

Edit

Logstash

Service overview

The Logstash service runs on PM server. It has two pipelines:

  • logstash-spa. This pipeline receives log events from all Filebeat services and puts them into the /opt/workfusion/logs directory.
  • logstash-automl-extract. This pipeline receives log events from running AutoML extract models and puts tehm into the /opt/workfusion/vds_master/AUTOML-MASTER_HOSTNAME/automl-extract directory.
Software owner Elasticsearch BV
Management

wfmanager (start | stop | restart | status) logstash
Log files

Access logs: <INSTALL_DIR>/supervisord/log/logstash.out.log
Error logs: <INSTALL_DIR>/supervisord/log/logstash.err.log
Startup scripts <INSTALL_DIR>/supervisord/apps/logstash.ini
<INSTALL_DIR>/logstash/bin/logstash
Configuration files

<INSTALL_DIR>/logstash/logstash.conf
Default Ports

tcp 4567 (logstash-spa) 4568 (logstash-automl-extract)

Default parameters

Configuration fileNameDefault valueDescription
config.ymlinstall_dir/opt/workfusionDirectory to put user files, logs and configs

Troubleshooting

  • Check if TCP port 4567 is available. Ports may be custom:

    netstat command output

    $ etstat -lntp | grep 4567
tcp6       0      0 :::4567                 :::*                    LISTEN      23433/java

    ss command output

    $ ss -ltn | egrep 4567
LISTEN     0      50          :::4567                    :::*

    lsof command output

    $ lsof -P -n -i :4567 | grep LISTEN
java    23433 wfuser   17u  IPv6 117393      0t0  TCP *:4567 (LISTEN)

  • Check service standard logs:

    • Output logs: <INSTALL_DIR>/supervisord/log/logstash.out.log
    • Error logs: <INSTALL_DIR>/supervisord/log/logstash.err.log
    $ tail -f <INSTALL_DIR>/supervisord/log/logstash.err.log <INSTALL_DIR>/supervisord/log/logstash.out.log

  • Check the logstash out (access) log using the Wfmanager util.

    wfmanager tail logstash

  • Enable debug information.

    Set the appropriate log level to <INSTALL_DIR>/supervisord/apps/logstash.ini (default is info) and restart the logstash service:

    ${install_dir}/supervisord/apps/logstash.ini

    From:
exec bin/logstash

To:
exec bin/logstash --log.level debug

    wfmanager restart logstash
← PreviousNext →