- Design ingestion pipelines feeding analytics and AI/GenAI use cases.
- Ingest structured and unstructured data from multiple sources into the AWS data lake
- Prepare AI-ready datasets, including document parsing, chunking and embedding pipelines
- Build reusable, metadata-driven ingestion frameworks
Requirements
Must have: 4+ yrs, AWS (Glue, S3, Lambda, Step Functions, Kinesis), Python, PySpark.
Nice to have: Bedrock, vector databases, OpenSearch
Job description provided by Radcube.
View the original posting