Job Description
JD: Lead AI Engineer, Agentic Data Lineage What You Will Do: Define and drive the technical strategy for a Firmwide, column-level data lineage platform built on AI reasoning agents. Architect parsers that build Abstract Syntax Trees (ASTs) from SQL across multiple dialects, stored procedures, Python, Java, Scala, and Spark jobs, then resolve column-level transformations from those trees. Design ingestion of no-code signals from ETL and transformation tools, workflow orchestrators, data catalogs…
