-
Notifications
You must be signed in to change notification settings - Fork 37
Per collection start or stop
Social Computing edited this page May 11, 2015
·
2 revisions
The aidr-collector requires explicit per-collection start/stop to operate. This start/stop command is issued aidr-manager through the aidr-collector API.
The aidr-persister also requires explicit per-collection start/stop to operate. This start/stop command is issued by aidr-collector through the aidr-persister API. This is legacy of an old design, ideally the persister should not require explicit start/stop.
The aidr-output and aidr-analytics module do not require explicit per-collection start/stop.
Instead, each of these modules independently does the following:
- listen to the Redis queue to which aidr-tagger writes
- every time it detects a new collection, create a new in-memory data structure for that collections
- in-memory data structures are destroyed if inactive for a long time
- Home
- [What is AIDR?](AIDR Overview)
- The science behind AIDR
- [Operator's manual](AIDR Operator's Manual)
- [Public API documentation](API documentation)
- High-level overview
- Common
- DB Manager
- DTO standards
- Database schema
- Manager
- Manager API
- Collector
- Collector API
- Reconnect strategy
- Collector Tester
- Output
- Output API
- Output Buffered
- Output Streaming
- Output Tester
- Persister
- Persister API
- Persister Tester
- Tagger
- Tagger Concepts
- Tagger API
- Tagger Tester
- Trainer
- Trainer API
- PyBossa Trainer