Project - | LLM Agent For Planning Data Pipelines |
Objective | Design a planning agent that can synthesize a pipeline from a natural language specification primarily targeting data engineer persona. |
Outcomes | Working agent that can receive natural language pipeline objective, break it down into steps and use a mix of standard and custom operators to realize pipeline.
Agent should be able to feed to a code synthesis copilot to synthesize custom operators |
Apply by Date | 31/07/2024 |
Applied Teams | 2 / 2 |
Duration | 3 months |
College | All College |
Tools-Technologies | Jupyter Python Notebooks, Spark |
Mentor | Anand Eswaran |
Platform | 1 ) Watson Data Platform
|