Serves as the main entry point for setting up and configuring the mapreduce pipeline. More...
#include <pipeline.h>
Classes | |
| class | InputSpec |
| Convenience class that represents multiple types that can be treated as input globs. More... | |
Public Member Functions | |
| Pipeline (util::IoContextPool *pool) | |
| PInput< std::string > | ReadText (const std::string &name, const InputSpec &input_spec) |
| PInput< std::string > | ReadText (const std::string &name, const std::string &glob) |
| PInput< std::string > | ReadLst (const std::string &name, const InputSpec &input_spec) |
| PInput< std::string > | ReadLst (const std::string &name, const std::vector< std::string > &globs) |
| PInput< std::string > | ReadLst (const std::string &name, const std::string &glob) |
| bool | Run (Runner *runner) |
| Runs the pipeline and blocks the current thread. More... | |
| void | Stop () |
| Stops/breaks the run. | |
| template<typename GrouperType , typename Out , typename... Args> | |
| PTable< Out > | Join (const std::string &name, std::initializer_list< detail::HandlerBinding< GrouperType, Out >> mapper_bindings, Args &&... args) |
| pb::Input * | mutable_input (const std::string &) |
| template<class T > | |
| const FrequencyMap< T > * | GetFreqMap (const std::string &map_id) const |
| template<typename GrouperType , typename OutT , typename... Args> | |
| PTable< OutT > | Join (const std::string &name, std::initializer_list< detail::HandlerBinding< GrouperType, OutT >> mapper_bindings, Args &&... args) |
Serves as the main entry point for setting up and configuring the mapreduce pipeline.
Usually returned by PipelineMain object and used to read initial inputs or to join between one or more tables.
Definition at line 42 of file pipeline.h.
| bool mr3::Pipeline::Run | ( | Runner * | runner | ) |
Runs the pipeline and blocks the current thread.
| runner |
1.8.15