dogstreams does not pick up newly created log files when using wildcard

[jonauman]

Additional environment details (Operating System, Cloud provider, etc):
OS: Linaro (Ubuntu)
Arch: armhf

Steps to reproduce the issue:

1. Add this to datadog.conf:
   dogstreams: /home/cbuser/.cortex/log/player.json.*:/opt/datadog-agent/agent/cortex_log_plays.py:cortex_parser
2. restart the agent

Describe the results you received:
As new logs appear (logrotate) over time, they do not get picked up by dogstreams.

Describe the results you expected:
I would expect that all logs matching the wildcard would get processed, not only the logs matching at time of agent startup.

Additional information you deem important (e.g. issue happens only occasionally):
Datadog support has provided a fix for collector.py (358-259):

357        if self._dogstream is not None:
358            if (self.run_count % 10) == 0:
359                self._dogstream = Dogstreams.init(log, self.agentConfig)

I have tested this patch and it works. Can we get this added into the codebase?

Since we are on armhf architecture, we must install the agent from source and would like to avoid having to patch the file every time we upgrade the agent.

Zendesk ticket 131296 was opened (and resolved) in reference to this issue.

[nsushain]

Can we get his merged? facing the same issue

[edwardjlam]

is there any update on this? currently facing this issue as well.