2017年1月27日金曜日

docker-compose でJobSchedulerAgnet クラスタを試す

下記ページを参考に、JobSchedulerAgnetクラスタを試してみます。
https://kb.sos-berlin.com/display/PKB/How+to+use+Agents+with+Fixed+Priority+Scheduling+and+Round-Robin+Scheduling
docker-compose で JobScheduler Agent を使う」で構築したテスト環境を使用します。


docker-compose でテスト環境の起動


docker-compose でテスト環境を起動して、js_agnet コンテナを2台に増やします。
[root@centos0702 sosjs]# docker-compose up -d
Creating sosjs_db_1
Creating sosjs_js_agent_1
Creating sosjs_datastore_1
Creating sosjs_jobscheduler_1
[root@centos0702 sosjs]# docker-compose scale js_agent=2
Creating and starting sosjs_js_agent_2 ... done

コンテナの状態を確認します。
[root@centos0702 sosjs]# docker-compose ps
        Name                      Command               State                               Ports
----------------------------------------------------------------------------------------------------------------------------
sosjs_datastore_1      /bin/true                        Exit 0
sosjs_db_1             docker-entrypoint.sh mysqld      Up       3306/tcp
sosjs_jobscheduler_1   bash /opt/startup_scheduler.sh   Up       0.0.0.0:40444->40444/tcp, 0.0.0.0:4444->4444/tcp, 48444/tcp
sosjs_js_agent_1       /root/jobscheduler_agent/b ...   Up
sosjs_js_agent_2       /root/jobscheduler_agent/b ...   Up

js_agentコンテナの IPアドレスを確認します。
[root@centos0702 sosjs]# docker inspect sosjs_js_agent_1 | grep IPAddress
            "SecondaryIPAddresses": null,
            "IPAddress": "172.17.0.3",
                    "IPAddress": "172.17.0.3",
[root@centos0702 sosjs]# docker inspect sosjs_js_agent_2 | grep IPAddress
            "SecondaryIPAddresses": null,
            "IPAddress": "172.17.0.5",
                    "IPAddress": "172.17.0.5",

プロセスクラスを定義


js_agentコンテナでジョブを実行するためにプロセスクラスを定義します。
以下は、Primary/Fallback型です。通常は sosjs_js_agent_1 でジョブを実行します。
sosjs_js_agent_1 がダウンすると、 sosjs_js_agnet_2 でジョブを実行します。
sosjs_js_agnet_1 が復旧しれば、sosjs_js_agnet_1 でジョブが実行されます。
[root@centos0702 sosjs]# cat ./live/test/fallback.process_class.xml
<?xml version="1.0" encoding="ISO-8859-1"?>
<process_class>
    <remote_schedulers select="first">
        <remote_scheduler  remote_scheduler="http://172.17.0.3:4445"/>
        <remote_scheduler  remote_scheduler="http://172.17.0.5:4445"/>
    </remote_schedulers>
</process_class>

以下は、Raundrobin型です。 sosjs_js_agent_1 と sosjs_js_agent_2 を交互に使用してジョブを実行します。
[root@centos0702 sosjs]# cat ./live/test/raundrobin.process_class.xml
<?xml version="1.0" encoding="ISO-8859-1"?>
<process_class>
    <remote_schedulers select="next">
        <remote_scheduler  remote_scheduler="http://172.17.0.3:4445"/>
        <remote_scheduler  remote_scheduler="http://172.17.0.5:4445"/>
    </remote_schedulers>
</process_class>

JobChain を定義


上記のプロセスクラスを使うJobChainを定義します。
job_chain1 は Primary/Fallback 型です。
[root@centos0702 sosjs]# cat ./live/test/job_chain1.job_chain.xml
<?xml version="1.0" encoding="ISO-8859-1"?>
<job_chain  process_class="fallback">
    <job_chain_node  state="job01" job="job01" next_state="success" error_state="error"/>
    <job_chain_node  state="success"/>
    <job_chain_node  state="error"/>
</job_chain>

job_chain2 は Raundrobin 型です。
[root@centos0702 sosjs]# cat ./live/test/job_chain2.job_chain.xml
<?xml version="1.0" encoding="ISO-8859-1"?>
<job_chain  process_class="raundrobin">
    <job_chain_node  state="job01" job="job01" next_state="success" error_state="error"/>
    <job_chain_node  state="success"/>
    <job_chain_node  state="error"/>
</job_chain>

ジョブはIPアドレスを表示します。
[root@centos0702 sosjs]# cat ./live/test/job01.job.xml
<?xml version="1.0" encoding="ISO-8859-1"?>
<job  order="yes">
    <script  language="shell">
        <![CDATA[
ip a
        ]]>
    </script>
    <run_time />
</job>

Primary/Fallback型の動作確認


sosjs_js_agent_1 と sosjs_js_agnet_2 が起動している状態で、job_chain1 を実行してログを見てみます。
何回実行しても sosjs_js_agent_1 でジョブが実行されます。
2017-01-24 05:29:13.507Z [info]   (Task test/job01:5) SCHEDULER-842  Task is going to process Order test/job_chain1:2, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444', Order's Process_class test/fallback
2017-01-24 05:29:13.509Z [info]   (Task test/job01:5) 
2017-01-24 05:29:13.509Z [info]   (Task test/job01:5) Task test/job01:5 - Protocol starts in /opt/jobscheduler/data/scheduler/logs/task.test,job01.log
2017-01-24 05:29:22.519Z [info]   (Task test/job01:5) SCHEDULER-726  Task runs on remote scheduler http://172.17.0.3:4445
2017-01-24 05:29:22.519Z [info]   (Task test/job01:5) SCHEDULER-918  state=starting (at=never)
2017-01-24 05:29:24.838Z [info]   (Task test/job01:5) [stdout] 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
2017-01-24 05:29:24.853Z [info]   (Task test/job01:5) [stdout]     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2017-01-24 05:29:24.873Z [info]   (Task test/job01:5) [stdout]     inet 127.0.0.1/8 scope host lo
2017-01-24 05:29:24.890Z [info]   (Task test/job01:5) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:29:24.906Z [info]   (Task test/job01:5) [stdout]     inet6 ::1/128 scope host 
2017-01-24 05:29:24.921Z [info]   (Task test/job01:5) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:29:24.936Z [info]   (Task test/job01:5) [stdout] 18: eth0@if19: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default 
2017-01-24 05:29:24.954Z [info]   (Task test/job01:5) [stdout]     link/ether 02:42:ac:11:00:03 brd ff:ff:ff:ff:ff:ff
2017-01-24 05:29:24.972Z [info]   (Task test/job01:5) [stdout]     inet 172.17.0.3/16 scope global eth0
2017-01-24 05:29:24.990Z [info]   (Task test/job01:5) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:29:25.007Z [info]   (Task test/job01:5) [stdout]     inet6 fe80::42:acff:fe11:3/64 scope link 
2017-01-24 05:29:25.022Z [info]   (Task test/job01:5) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:29:25.196Z [info]   (Task test/job01:5) SCHEDULER-843  Task has ended processing of Order test/job_chain1:2, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444'
2017-01-24 05:29:25.289Z [info]   set_state success
2017-01-24 05:29:25.324Z [info]   SCHEDULER-945  No further job in job chain - order has been carried out
2017-01-24 05:29:25.324Z [info]   SCHEDULER-940  Removing order from job chain

sosjs_js_agent_1 を停止します。
[root@centos0702 sosjs]# docker stop sosjs_js_agent_1
sosjs_js_agent_1
[root@centos0702 sosjs]# docker-compose ps
        Name                      Command                State                                Ports
------------------------------------------------------------------------------------------------------------------------------
sosjs_datastore_1      /bin/true                        Exit 0
sosjs_db_1             docker-entrypoint.sh mysqld      Up         3306/tcp
sosjs_jobscheduler_1   bash /opt/startup_scheduler.sh   Up         0.0.0.0:40444->40444/tcp, 0.0.0.0:4444->4444/tcp, 48444/tcp
sosjs_js_agent_1       /root/jobscheduler_agent/b ...   Exit 137
sosjs_js_agent_2       /root/jobscheduler_agent/b ...   Up

job_chain1 を実行してログを見てみます。
sosjs_js_agnet_1 にアクセスできないので sosjs_js_agnet_2 でジョブを実行しています。
2017-01-24 05:34:33.204Z [info]   (Task test/job01:7) SCHEDULER-842  Task is going to process Order test/job_chain1:4, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444', Order's Process_class test/fallback
2017-01-24 05:34:33.206Z [info]   (Task test/job01:7) 
2017-01-24 05:34:33.206Z [info]   (Task test/job01:7) Task test/job01:7 - Protocol starts in /opt/jobscheduler/data/scheduler/logs/task.test,job01.log
2017-01-24 05:34:36.726Z [WARN]   (Task test/job01:7) SCHEDULER-488  This remote JobScheduler 'Agent(0,http://172.17.0.3:4445,None)' is not accessible: spray.can.Http$ConnectionAttemptFailedException: Connection attempt to 172.17.0.3:4445 failed
2017-01-24 05:34:40.536Z [info]   (Task test/job01:7) SCHEDULER-726  Task runs on remote scheduler http://172.17.0.5:4445
2017-01-24 05:34:40.537Z [info]   (Task test/job01:7) SCHEDULER-918  state=starting (at=never)
2017-01-24 05:34:41.807Z [info]   (Task test/job01:7) [stdout] 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
2017-01-24 05:34:41.829Z [info]   (Task test/job01:7) [stdout]     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2017-01-24 05:34:41.848Z [info]   (Task test/job01:7) [stdout]     inet 127.0.0.1/8 scope host lo
2017-01-24 05:34:41.905Z [info]   (Task test/job01:7) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:34:41.952Z [info]   (Task test/job01:7) [stdout]     inet6 ::1/128 scope host 
2017-01-24 05:34:42.016Z [info]   (Task test/job01:7) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:34:42.043Z [info]   (Task test/job01:7) [stdout] 24: eth0@if25: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default 
2017-01-24 05:34:42.070Z [info]   (Task test/job01:7) [stdout]     link/ether 02:42:ac:11:00:05 brd ff:ff:ff:ff:ff:ff
2017-01-24 05:34:42.095Z [info]   (Task test/job01:7) [stdout]     inet 172.17.0.5/16 scope global eth0
2017-01-24 05:34:42.119Z [info]   (Task test/job01:7) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:34:42.143Z [info]   (Task test/job01:7) [stdout]     inet6 fe80::42:acff:fe11:5/64 scope link 
2017-01-24 05:34:42.162Z [info]   (Task test/job01:7) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:34:42.283Z [info]   (Task test/job01:7) SCHEDULER-843  Task has ended processing of Order test/job_chain1:4, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444'
2017-01-24 05:34:42.284Z [info]   set_state success
2017-01-24 05:34:42.284Z [info]   SCHEDULER-945  No further job in job chain - order has been carried out
2017-01-24 05:34:42.285Z [info]   SCHEDULER-940  Removing order from job chain

sosjs_js_agnet_1 を起動して復旧します。
[root@centos0702 sosjs]# docker start sosjs_js_agent_1
sosjs_js_agent_1
[root@centos0702 sosjs]# docker-compose ps
        Name                      Command               State                               Ports
----------------------------------------------------------------------------------------------------------------------------
sosjs_datastore_1      /bin/true                        Exit 0
sosjs_db_1             docker-entrypoint.sh mysqld      Up       3306/tcp
sosjs_jobscheduler_1   bash /opt/startup_scheduler.sh   Up       0.0.0.0:40444->40444/tcp, 0.0.0.0:4444->4444/tcp, 48444/tcp
sosjs_js_agent_1       /root/jobscheduler_agent/b ...   Up
sosjs_js_agent_2       /root/jobscheduler_agent/b ...   Up

job_chain1 を実行します。
sosjs_js_agent_1 でジョブが実行されます。
2017-01-24 05:42:40.483Z [info]   (Task test/job01:8) SCHEDULER-842  Task is going to process Order test/job_chain1:5, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444', Order's Process_class test/fallback
2017-01-24 05:42:40.484Z [info]   (Task test/job01:8) 
2017-01-24 05:42:40.484Z [info]   (Task test/job01:8) Task test/job01:8 - Protocol starts in /opt/jobscheduler/data/scheduler/logs/task.test,job01.log
2017-01-24 05:42:41.698Z [info]   (Task test/job01:8) SCHEDULER-726  Task runs on remote scheduler http://172.17.0.3:4445
2017-01-24 05:42:41.698Z [info]   (Task test/job01:8) SCHEDULER-918  state=starting (at=never)
2017-01-24 05:42:42.574Z [info]   (Task test/job01:8) [stdout] 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
2017-01-24 05:42:42.597Z [info]   (Task test/job01:8) [stdout]     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2017-01-24 05:42:42.616Z [info]   (Task test/job01:8) [stdout]     inet 127.0.0.1/8 scope host lo
2017-01-24 05:42:42.634Z [info]   (Task test/job01:8) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:42:42.665Z [info]   (Task test/job01:8) [stdout]     inet6 ::1/128 scope host 
2017-01-24 05:42:42.687Z [info]   (Task test/job01:8) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:42:42.714Z [info]   (Task test/job01:8) [stdout] 26: eth0@if27: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default 
2017-01-24 05:42:42.745Z [info]   (Task test/job01:8) [stdout]     link/ether 02:42:ac:11:00:03 brd ff:ff:ff:ff:ff:ff
2017-01-24 05:42:42.768Z [info]   (Task test/job01:8) [stdout]     inet 172.17.0.3/16 scope global eth0
2017-01-24 05:42:42.797Z [info]   (Task test/job01:8) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:42:42.839Z [info]   (Task test/job01:8) [stdout]     inet6 fe80::42:acff:fe11:3/64 scope link 
2017-01-24 05:42:42.862Z [info]   (Task test/job01:8) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:42:43.015Z [info]   (Task test/job01:8) SCHEDULER-843  Task has ended processing of Order test/job_chain1:5, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444'
2017-01-24 05:42:43.025Z [info]   set_state success
2017-01-24 05:42:43.026Z [info]   SCHEDULER-945  No further job in job chain - order has been carried out
2017-01-24 05:42:43.026Z [info]   SCHEDULER-940  Removing order from job chain

Raundrobin型の動作確認


sosjs_js_agent_1 と sosjs_js_agnet_2 が起動している状態で、job_chain2 を実行してログを見てみます。
1回名は sosjs_js_agnet_1 でジョブが実行されました。
2017-01-24 05:45:40.868Z [info]   (Task test/job01:9) SCHEDULER-842  Task is going to process Order test/job_chain2:6, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444', Order's Process_class test/raundrobin
2017-01-24 05:45:40.869Z [info]   (Task test/job01:9) 
2017-01-24 05:45:40.869Z [info]   (Task test/job01:9) Task test/job01:9 - Protocol starts in /opt/jobscheduler/data/scheduler/logs/task.test,job01.log
2017-01-24 05:45:40.998Z [info]   (Task test/job01:9) SCHEDULER-726  Task runs on remote scheduler http://172.17.0.3:4445
2017-01-24 05:45:40.998Z [info]   (Task test/job01:9) SCHEDULER-918  state=starting (at=never)
2017-01-24 05:45:41.311Z [info]   (Task test/job01:9) [stdout] 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
2017-01-24 05:45:41.323Z [info]   (Task test/job01:9) [stdout]     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2017-01-24 05:45:41.338Z [info]   (Task test/job01:9) [stdout]     inet 127.0.0.1/8 scope host lo
2017-01-24 05:45:41.859Z [info]   (Task test/job01:9) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:45:41.875Z [info]   (Task test/job01:9) [stdout]     inet6 ::1/128 scope host 
2017-01-24 05:45:41.889Z [info]   (Task test/job01:9) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:45:41.905Z [info]   (Task test/job01:9) [stdout] 26: eth0@if27: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default 
2017-01-24 05:45:41.918Z [info]   (Task test/job01:9) [stdout]     link/ether 02:42:ac:11:00:03 brd ff:ff:ff:ff:ff:ff
2017-01-24 05:45:41.930Z [info]   (Task test/job01:9) [stdout]     inet 172.17.0.3/16 scope global eth0
2017-01-24 05:45:41.942Z [info]   (Task test/job01:9) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:45:41.965Z [info]   (Task test/job01:9) [stdout]     inet6 fe80::42:acff:fe11:3/64 scope link 
2017-01-24 05:45:41.977Z [info]   (Task test/job01:9) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:45:42.017Z [info]   (Task test/job01:9) SCHEDULER-843  Task has ended processing of Order test/job_chain2:6, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444'
2017-01-24 05:45:42.018Z [info]   set_state success
2017-01-24 05:45:42.018Z [info]   SCHEDULER-945  No further job in job chain - order has been carried out
2017-01-24 05:45:42.018Z [info]   SCHEDULER-940  Removing order from job chain

2回目は、sosjs_js_agnet_2 でジョブが実行されました。
2017-01-24 05:46:45.830Z [info]   (Task test/job01:10) SCHEDULER-842  Task is going to process Order test/job_chain2:7, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444', Order's Process_class test/raundrobin
2017-01-24 05:46:45.831Z [info]   (Task test/job01:10) 
2017-01-24 05:46:45.831Z [info]   (Task test/job01:10) Task test/job01:10 - Protocol starts in /opt/jobscheduler/data/scheduler/logs/task.test,job01.log
2017-01-24 05:46:45.949Z [info]   (Task test/job01:10) SCHEDULER-726  Task runs on remote scheduler http://172.17.0.5:4445
2017-01-24 05:46:45.950Z [info]   (Task test/job01:10) SCHEDULER-918  state=starting (at=never)
2017-01-24 05:46:46.313Z [info]   (Task test/job01:10) [stdout] 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
2017-01-24 05:46:46.330Z [info]   (Task test/job01:10) [stdout]     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2017-01-24 05:46:46.348Z [info]   (Task test/job01:10) [stdout]     inet 127.0.0.1/8 scope host lo
2017-01-24 05:46:46.361Z [info]   (Task test/job01:10) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:46:46.373Z [info]   (Task test/job01:10) [stdout]     inet6 ::1/128 scope host 
2017-01-24 05:46:46.384Z [info]   (Task test/job01:10) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:46:46.396Z [info]   (Task test/job01:10) [stdout] 24: eth0@if25: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default 
2017-01-24 05:46:46.408Z [info]   (Task test/job01:10) [stdout]     link/ether 02:42:ac:11:00:05 brd ff:ff:ff:ff:ff:ff
2017-01-24 05:46:46.421Z [info]   (Task test/job01:10) [stdout]     inet 172.17.0.5/16 scope global eth0
2017-01-24 05:46:46.657Z [info]   (Task test/job01:10) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:46:46.675Z [info]   (Task test/job01:10) [stdout]     inet6 fe80::42:acff:fe11:5/64 scope link 
2017-01-24 05:46:46.693Z [info]   (Task test/job01:10) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:46:46.738Z [info]   (Task test/job01:10) SCHEDULER-843  Task has ended processing of Order test/job_chain2:7, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444'
2017-01-24 05:46:46.739Z [info]   set_state success
2017-01-24 05:46:46.739Z [info]   SCHEDULER-945  No further job in job chain - order has been carried out
2017-01-24 05:46:46.739Z [info]   SCHEDULER-940  Removing order from job chain

sosjs_js_agnet_1 を停止します。
[root@centos0702 sosjs]# docker stop sosjs_js_agent_1
sosjs_js_agent_1
[root@centos0702 sosjs]# docker ps
CONTAINER ID        IMAGE                      COMMAND                  CREATED             STATUS              PORTS                                                         NAMES
4779e1feeeb3        js_agent                   "/root/jobscheduler_a"   37 minutes ago      Up 37 minutes                                                                     sosjs_js_agent_2
e0c8b2f803c6        floedermann/jobscheduler   "bash /opt/startup_sc"   55 minutes ago      Up 55 minutes       0.0.0.0:4444->4444/tcp, 0.0.0.0:40444->40444/tcp, 48444/tcp   sosjs_jobscheduler_1
42db58764992        mariadb                    "docker-entrypoint.sh"   55 minutes ago      Up 55 minutes       3306/tcp                                                      sosjs_db_1

job_chain2 を実行してみます。
sosjs_js_agnet_1 にアクセスできなければ、sosjs_js_agnet_2 でジョブを実行します。
2017-01-24 05:49:25.811Z [info]   (Task test/job01:11) SCHEDULER-842  Task is going to process Order test/job_chain2:8, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444', Order's Process_class test/raundrobin
2017-01-24 05:49:25.812Z [info]   (Task test/job01:11) 
2017-01-24 05:49:25.812Z [info]   (Task test/job01:11) Task test/job01:11 - Protocol starts in /opt/jobscheduler/data/scheduler/logs/task.test,job01.log
2017-01-24 05:49:28.871Z [WARN]   (Task test/job01:11) SCHEDULER-488  This remote JobScheduler 'Agent(0,http://172.17.0.3:4445,None)' is not accessible: spray.can.Http$ConnectionAttemptFailedException: Connection attempt to 172.17.0.3:4445 failed
2017-01-24 05:49:29.000Z [info]   (Task test/job01:11) SCHEDULER-726  Task runs on remote scheduler http://172.17.0.5:4445
2017-01-24 05:49:29.000Z [info]   (Task test/job01:11) SCHEDULER-918  state=starting (at=never)
2017-01-24 05:49:29.223Z [info]   (Task test/job01:11) [stdout] 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1
2017-01-24 05:49:29.234Z [info]   (Task test/job01:11) [stdout]     link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
2017-01-24 05:49:29.249Z [info]   (Task test/job01:11) [stdout]     inet 127.0.0.1/8 scope host lo
2017-01-24 05:49:29.266Z [info]   (Task test/job01:11) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:49:29.290Z [info]   (Task test/job01:11) [stdout]     inet6 ::1/128 scope host 
2017-01-24 05:49:29.303Z [info]   (Task test/job01:11) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:49:29.317Z [info]   (Task test/job01:11) [stdout] 24: eth0@if25: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default 
2017-01-24 05:49:29.334Z [info]   (Task test/job01:11) [stdout]     link/ether 02:42:ac:11:00:05 brd ff:ff:ff:ff:ff:ff
2017-01-24 05:49:29.346Z [info]   (Task test/job01:11) [stdout]     inet 172.17.0.5/16 scope global eth0
2017-01-24 05:49:29.360Z [info]   (Task test/job01:11) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:49:29.373Z [info]   (Task test/job01:11) [stdout]     inet6 fe80::42:acff:fe11:5/64 scope link 
2017-01-24 05:49:29.385Z [info]   (Task test/job01:11) [stdout]        valid_lft forever preferred_lft forever
2017-01-24 05:49:29.421Z [info]   (Task test/job01:11) SCHEDULER-843  Task has ended processing of Order test/job_chain2:8, state=job01, on JobScheduler 'http://e0c8b2f803c6:4444'
2017-01-24 05:49:29.422Z [info]   set_state success
2017-01-24 05:49:29.422Z [info]   SCHEDULER-945  No further job in job chain - order has been carried out
2017-01-24 05:49:29.422Z [info]   SCHEDULER-940  Removing order from job chain