Project
LLM Agent For Planning Data Pipelines
Objective
Design a planning agent that can synthesize a pipeline from a natural language specification primarily targeting data engineer persona.
Outcome
Working agent that can receive natural language pipeline objective, break it down into steps and use a mix of standard and custom operators to realize pipeline. Agent should be able to feed to a code synthesis copilot to synthesize custom operators
Apply By Date 31 Jul 2024
Students 2 / 2
Duration 3 months
Mentor Anand Eswaran
Tools-Technologies
Jupyter Python Notebooks, Spark
Platform
1 ) WatsonX
College
All College