Associate - Business Analyst

Description Job Description BI Analyst / Senior Consultant – Business Intelligence & AI Job Title BI Analyst / Senior Consultant – BI & AI Experience 6–9 Years Location Hybrid / Remote Job Summary We are seeking an experienced BI Analyst / Senior Consultant with 6–9 years of hands-on expertise in business intelligence, advanced analytics, and data engineering — combined with growing exposure to AI/LLM application development. The ideal candidate brings strong proficiency in SQL, Python, and PySpark for data processing, alongside deep BI platform expertise in Power BI or Tableau. They will have experience building governed semantic layers, developing scalable data pipelines, and integrating Large Language Model (LLM) capabilities into analytics workflows. This role sits at the intersection of traditional BI and next-generation AI-augmented analytics, making it ideal for a technically strong consultant ready to lead complex data initiatives. Key Responsibilities Data Engineering & Pipeline Development • Write complex SQL queries, stored procedures, and optimized transformations across platforms such as Snowflake, Azure Synapse, BigQuery, or Redshift. • Develop and maintain scalable data pipelines using Python and PySpark for large-scale batch and near-real-time data processing. • Build and manage ELT/ETL workflows using dbt, ADF, Airflow, or Fivetran to ingest structured and semi-structured data. • Implement Spark-based data processing on Databricks or Azure HDInsight for high-volume analytics workloads. • Optimize query performance through partitioning, clustering, caching strategies, and execution plan analysis. BI Development & Reporting • Design, develop, and deploy enterprise-grade dashboards and reports using Power BI (DAX, Power Query, Composite Models) and Tableau. • Build semantic models, calculated measures, KPI frameworks, and row-level security (RLS) configurations in Power BI or Looker. • Develop LookML models, explores, and views in Looker to expose governed data layers for self-service analytics. • Optimize BI report performance through DirectQuery tuning, aggregation tables, and incremental refresh strategies. • Lead and mentor junior analysts in BI development standards, DAX best practices, and data modeling techniques. Semantic Layer & Dimensional Modeling • Design and maintain enterprise semantic models using dbt Semantic Layer, Power BI Semantic Models, Cube.dev, or AtScale. • Build dimensional models (Star Schema, Snowflake Schema) with fact and dimension tables optimized for analytical query patterns. • Define and standardize reusable business metrics, KPIs, hierarchies, and dimensions across reporting platforms. • Ensure metric consistency and single source of truth across BI, dashboards, and AI-driven outputs. AI & LLM Application Development (Exposure Required) • Develop or contribute to AI-powered analytics applications using LLM APIs such as OpenAI GPT-4, Azure OpenAI, or Anthropic Claude. • Build Retrieval-Augmented Generation (RAG) pipelines using frameworks such as LangChain or LlamaIndex to enable natural language querying over structured and unstructured data. • Integrate LLM-generated insights, AI summaries, and conversational BI interfaces into existing Power BI or Tableau reporting workflows. • Use Python libraries (openai, langchain, transformers, sentence-transformers) to prototype and deploy AI-driven analytics features. • Implement vector search and embedding-based retrieval using tools such as FAISS, Pinecone, or Azure AI Search to surface contextual data insights. • Contribute to prompt engineering, fine-tuning strategies, and evaluation frameworks for LLM outputs in analytics contexts. • Explore and apply AI-native BI capabilities such as Power BI Copilot, Tableau Pulse, and Looker Explore AI. Advanced Analytics & Data Science Integration • Perform exploratory data analysis (EDA) using Python (pandas, numpy, matplotlib, seaborn, plotly) to surface trends and business insights. • Collaborate with data science teams to integrate ML model outputs (e.g., churn scores, forecasts, classification results) into BI reporting layers. • Develop statistical analyses, cohort analyses, and A/B test result reporting to support business experimentation. • Apply time-series analysis and forecasting techniques using Python (statsmodels, Prophet, scikit-learn) for business planning use cases. Stakeholder Engagement & Consulting • Act as a senior analytical advisor to business stakeholders, translating complex data findings into clear business narratives. • Lead requirement-gathering workshops, solution design sessions, and stakeholder demos for BI and AI analytics initiatives. • Document functional and technical specifications for data pipelines, semantic models, and BI solutions. • Participate in agile delivery — sprint planning, stand-ups, retrospectives — and manage delivery timelines for analytics workstreams. Data Quality & Governance • Implement data quality frameworks using dbt tests, Great Expectations, or custom SQL-based validation rules. • Maintain data lineage, documentation, and metadata cataloging using tools such as Microsoft Purview, Alation, or dbt Docs. • Define and enforce data governance standards, access control policies, and compliance requirements across BI and data assets. Required Skills Programming & Query Languages • SQL — Advanced: CTEs, window functions, query optimization, stored procedures, dynamic SQL • Python — Proficient: pandas, numpy, matplotlib, seaborn, sqlalchemy, requests, pyspark • PySpark — Experience with distributed data processing, DataFrame API, Spark SQL, and UDFs • DAX — Advanced: calculated columns, measures, time intelligence, row-level security • LookML — Experience building models, explores, and views in Looker • Shell scripting / Bash for pipeline automation and environment management BI & Visualization Platforms • Power BI — Advanced: Desktop, Service, Dataflows, Composite Models, Deployment Pipelines • Tableau — Proficient: calculated fields, LOD expressions, Tableau Prep, Tableau Server • Looker / LookML • Sigma Computing or ThoughtSpot (preferred) Data Platforms & Cloud • Snowflake — Warehouses, clustering, materialized views, Snowpipe, dynamic data masking • Azure: Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure SQL • AWS: Redshift, Glue, S3, Athena (preferred) • GCP: BigQuery, Dataflow, Looker (preferred) • Databricks — Delta Lake, Unity Catalog, MLflow (preferred) Data Engineering & Integration Tools • dbt (Core / Cloud) — models, tests, macros, seeds, snapshots, semantic layer • Apache Airflow — DAG development, scheduling, operators • Fivetran / Matillion / Azure Data Factory for data ingestion • Apache Kafka or Azure Event Hubs for streaming data (preferred) AI & LLM Technologies (Exposure Required) • LLM APIs: OpenAI GPT-4 / GPT-4o, Azure OpenAI Service, Anthropic Claude • LangChain or LlamaIndex for RAG pipeline development • Vector databases: FAISS, Pinecone, Weaviate, or Azure AI Search • Python AI libraries: openai, transformers, sentence-transformers, tiktoken • Prompt engineering, context management, and chain-of-thought techniques • Familiarity with AI-native BI tools: Power BI Copilot, Tableau Pulse, Looker Explore AI • Microsoft Fabric or Azure AI Foundry exposure (preferred) Semantic Layer Technologies • dbt Semantic Layer / MetricFlow • Power BI Semantic Models (Tabular / XMLA endpoint) • Cube.dev or AtScale • Snowflake Semantic Model (preferred) DevOps & Delivery • Git / GitHub / Azure DevOps — branching, pull requests, CI/CD pipelines • Docker basics for containerized analytics environments • Agile / Scrum delivery methodology • JIRA / Azure Boards for sprint and backlog management Preferred Qualifications • Bachelor’s or Master’s degree in Data Science, Computer Science, Statistics, Mathem