Reads data from a source to queues available to data layers. A single reading thread is created per source, even if multiple solvers are running in parallel, e.g. for multi-GPU training. This makes sure databases are read sequentially, and that each solver accesses a different subset of the database. Data is distributed to solvers in a round-robin way to keep parallel training deterministic.
More...
#include <data_reader.hpp>
|
static string | source_key (const LayerParameter ¶m) |
|
|
const shared_ptr< QueuePair > | queue_pair_ |
|
shared_ptr< Body > | body_ |
|
Reads data from a source to queues available to data layers. A single reading thread is created per source, even if multiple solvers are running in parallel, e.g. for multi-GPU training. This makes sure databases are read sequentially, and that each solver accesses a different subset of the database. Data is distributed to solvers in a round-robin way to keep parallel training deterministic.
The documentation for this class was generated from the following files: