running fluentd gives "The system cannot find the path specified" with td-agent Windows

[RodolpheGohard]

Hello, I've just installed tg-agent on windows via the MSI installer

I'm running through the official install-by-msi instructions, but I'm stuck when trying to run fluentd in td-agent. fluentd is not found

D:\apps\td-agent>fluentd -c etc\td-agent\td-agent.conf
The system cannot find the path specified.
 
D:\apps\td-agent>dir
Volume in drive D is Data
Volume Serial Number is 24FF-62D0
 
Directory of D:\apps\td-agent
 
19/09/2018  16:14    <DIR>          .
19/09/2018  16:14    <DIR>          ..
19/09/2018  16:14    <DIR>          bin
19/09/2018  16:14    <DIR>          embedded
19/09/2018  16:14    <DIR>          etc
25/01/2018  10:09             2,602 LICENSE
19/09/2018  16:14    <DIR>          LICENSES
25/01/2018  10:09                79 td-agent-prompt.bat
19/09/2018  16:14    <DIR>          usr
25/01/2018  10:09             5,914 version-manifest.json
25/01/2018  10:09             2,552 version-manifest.txt
 
D:\apps\td-agent>fluentd -c D:\app\td-agent\etc\td-agent\td-agent.conf
The system cannot find the path specified.
 
D:\apps\td-agent>where fluentd
INFO: Could not find files for the given pattern(s).
 
D:\apps\td-agent\bin>cd D:\apps\td-agent\embedded\bin
 
D:\apps\td-agent\embedded\bin>fluentd -c D:\app\td-agent\etc\td-agent\td-agent.c
onf
The system cannot find the path specified.
 
D:\apps\td-agent\embedded\bin>fluentd
The system cannot find the path specified.
 
D:\apps\td-agent\embedded\bin>echo %PATH%
"D:\apps\td-agent\embedded\bin";"D:\apps\td-agent\embedded\bin";xxxxxxxxx

• td-agent version: v3.1.1
• Environment information, e.g. OS. Windows 7

[cosmo0920]

I cannot reproduce this issue with the following steps:

• Install td-agent 3.1.1-0-x64.msi from here
• Click Td-agent Command Prompt in start menu
• Launch Fluentd: fluentd -c etc/td-agent/td-agent.conf

cmd> where fluentd
The system cannot find the path specified.
cmd> C:\opt\td-agent>fluentd -c etc/td-agent/td-agent.conf
2018-09-20 14:17:32 +0900 [info]: parsing config file is succeeded path="etc/td-agent/td-agent.conf"
2018-09-20 14:17:32 +0900 [warn]: [output_td] secondary type should be same with primary one primary="Fluent::Plugin::TreasureDataLogOutput" secondary="Fluent::Plugin::FileOutput"
2018-09-20 14:17:32 +0900 [info]: using configuration file: <ROOT>
  <match td.*.*>
    @type tdlog
    @id output_td
    apikey xxxxxx
    auto_create_table
    <buffer>
      @type "file"
      path "/var/log/td-agent/buffer/td"
    </buffer>
    <secondary>
      @type "file"
      path "/var/log/td-agent/failed_records"
      <buffer time>
        path /var/log/td-agent/failed_records
      </buffer>
    </secondary>
  </match>
  <match debug.**>
    @type stdout
    @id output_stdout
  </match>
  <source>
    @type forward
    @id input_forward
  </source>
  <source>
    @type http
    @id input_http
    port 8888
  </source>
  <source>
    @type debug_agent
    @id input_debug_agent
    bind "127.0.0.1"
    port 24230
  </source>
</ROOT>
2018-09-20 14:17:32 +0900 [info]: starting fluentd-1.0.2 pid=11240 ruby="2.4.2"
2018-09-20 14:17:32 +0900 [info]: spawn command to main:  cmdline=["C:/opt/td-agent/embedded/bin/ruby.exe", "-Eascii-8bit:ascii-8bit", "C:/opt/td-agent/embedded/bin/fluentd", "-c", "etc/td-agent/td-agent.conf", "--under-supervisor"]
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-elasticsearch' version '2.4.0'
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-kafka' version '0.6.5'
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.0.1'
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-s3' version '1.1.0'
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-td' version '1.0.0'
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-td-monitoring' version '0.2.3'
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-webhdfs' version '1.2.2'
2018-09-20 14:17:33 +0900 [info]: gem 'fluent-plugin-windows-eventlog' version '0.2.2'
2018-09-20 14:17:33 +0900 [info]: gem 'fluentd' version '1.0.2'
2018-09-20 14:17:33 +0900 [info]: adding match pattern="td.*.*" type="tdlog"
2018-09-20 14:17:33 +0900 [warn]: #0 [output_td] secondary type should be same with primary one primary="Fluent::Plugin::TreasureDataLogOutput" secondary="Fluent::Plugin::FileOutput"
2018-09-20 14:17:33 +0900 [info]: adding match pattern="debug.**" type="stdout"
2018-09-20 14:17:33 +0900 [info]: adding source type="forward"
2018-09-20 14:17:33 +0900 [info]: adding source type="http"
2018-09-20 14:17:33 +0900 [info]: adding source type="debug_agent"
2018-09-20 14:17:33 +0900 [info]: #0 starting fluentd worker pid=13140 ppid=11240 worker=0
2018-09-20 14:17:33 +0900 [info]: #0 [input_debug_agent] listening dRuby uri="druby://127.0.0.1:24230" object="Fluent::Engine"
2018-09-20 14:17:33 +0900 [info]: #0 [input_forward] listening port port=24224 bind="0.0.0.0"
2018-09-20 14:17:33 +0900 [info]: #0 fluentd worker is now running worker=0

• td-agent 3.1.1
• OS Windows 10 Home 1803 64bit

[RodolpheGohard]

Hello, I don't know if this changes anything, but I've installed it in D:\apps

[cosmo0920]

Using default installation path should solve this? I used default installation path.

[cosmo0920]

I tried to install td-agent 3.1.1-0-x64 D:\apps.
I've found that fluentd and its related batfile are pointed to C:\opt\td-agent.

@ECHO OFF
IF NOT "%~f0" == "~f0" GOTO :WinNT
@"C:\opt\td-agent\embedded\bin\ruby.exe" "C:/opt/td-agent/embedded/bin/fluentd" %1 %2 %3 %4 %5 %6 %7 %8 %9
GOTO :EOF
:WinNT
@"C:\opt\td-agent\embedded\bin\ruby.exe" "%~dpn0" %*

This is the packaging issue for td-agent.
Could you report this issue into omnibus-td-agent repository?

[RodolpheGohard]

done

[rahamath18]

Don't change the default location c:/opt | /etc.