Be part of a team that is transforming BCG into a bionic company! We are in the early stages of building Enterprise Data and Analytics platform that will ensure the uniformity, accuracy and accountability of enterprise-wide data and analytics capability for all the data domains.
The Chapter Lead - Director will work as part of an Agile squad composed of internal and external data architects, developers, data engineers, functional business partners, data stewards, software vendors and other service providers. The candidate will closely interact with colleagues in various Functional Groups, Data Tribe, external solution providing vendor to provide high quality data and analytics capabilities that respond to and meet the business needs of the global BCG organization.
The Lead Scalability will create architecture artefacts to enable BCG’s next generation of GenAIcapabilities.
The role will require to translate business requirements into specific systems, applications, or process designs for large complex cross functional BCG initiatives delivered through GenAI and platform technologies
This role reports to the Senior Director GenAI and will manage the strategic architecture and scalability of our GenAI applications
This is a senior and highly visible role. A key for success in this role is a unique blend of technical skills, business knowledge and working with and influencing multiple cross functional teams within IT and business on the right solutions. This person must be creative, ask questions, and be comfortable challenging the status quo.
It is imperative to write/speak clearly and precisely in a variety of communication settings and styles; listen effectively to understand perspective of others; and message in a clear and concise manner.
While working closely with users and providing a high level of customer service in a friendly, professional manner, the successful candidate must have:
- Cloud Infrastructure Management : Expertise in managing scalable cloud environments (AWS, Azure, GCP) with focus on high availability, scalability, and cost efficiency for SaaS applications.
- Multitenant Architecture Implementation: Proven experience in designing, managing, and scaling multitenant SaaS platforms, including isolation of data and resources per tenant, while optimizing resource sharing.
- LLM Integration: Deep understanding of how to integrate and scale LLM-based services (e.g., OpenAI, Hugging Face) within a multitenant SaaS architecture, ensuring optimal performance for language model tasks.
- Kubernetes & Containerization: Proficiency in managing containerized applications using Docker and orchestrating them with Kubernetes, ensuring zero-downtime deployments and multi-tenant isolation.
- CI/CD Pipelines: Designing and managing highly automated CI/CD pipelines that are optimized for rapid deployment, testing, and rollback for large-scale SaaS applications.
- Infrastructure as Code (IaC): Strong skills in Infrastructure as Code (e.g., Terraform, CloudFormation) to manage and scale cloud infrastructure for multitenant environments with consistency and automation.
- Database Scalability: Experience with databases (SQL, NoSQL) and scaling strategies like sharding, replication, and partitioning for multitenant systems, with a focus on performance and data isolation.
- Data Security & Tenant Isolation: Knowledge of implementing strict data isolation and security measures to ensure tenant data protection, including encryption, identity management, and RBAC (Role-Based Access Control).
- Compliance: Demonstrate expertise in managing regulatory and compliance standards (e.g., GDPR, SOC 2, HIPAA) for multitenant environments, with a focus on ensuring auditability and reporting.
- DevSecOps Integration: Integration of security into the DevOps process, ensuring security best practices (e.g., vulnerability scanning, automated testing) are part of the CI/CD pipeline.
- System Monitoring & Performance Tuning: Strong knowledge of monitoring tools (e.g., Prometheus, Grafana, Datadog) and performance optimization strategies to ensure both the infrastructure and LLM services scale efficiently in a multitenant setup.
- Cost Optimization: Expertise in cost management strategies for both cloud infrastructure and LLM APIs, optimizing resource usage to balance performance and cost in a multi-tenant SaaS model.
- Autoscaling: Knowledge of autoscaling techniques for cloud resources, containers, and LLM workloads to handle varying tenant demands and LLM model inference loads in real-time.
- Cross-functional Collaboration: Ability to collaborate with product, engineering, security, and AI/ML teams to ensure seamless integration of DevOps processes into the broader development lifecycle.
- Mentorship & Team Leadership: Proven track record of leading and mentoring DevOps teams, establishing best practices, and fostering a culture of continuous improvement and collaboration.
- Roadmap & Strategy: Experience in defining and executing the DevOps strategy aligned with the business goals, focusing on scalability, security, and performance of SaaS and AI-driven applications.
- Resilience & Fault Tolerance: Design and implement high availability and fault-tolerant systems across multitenant SaaS and LLM-based services, ensuring rapid recovery from failures.
Bachelor's degree or equivalent combination of education and experience.
Bachelor's degree in information science, data management, computer science or related field preferred.
10+ years of IT experience with major focus on platform projects
Strong interpersonal skills and ability to work cross-functionally
Excellent written, oral communication and presentation skills to present architecture, features and solution recommendations to senior management and C-level executives
Expertise in AWS, Terraform, SaaS and multitenant applications, infrastructure architecture design, monitoring, security.
Strong technical leadership across the entire CI/CD cycle
Expert across Devops and Secops areas
Strong QA and SRE exposure
Capacity to design complex solution architectures related to GenAI and LLM based application
Capacity to lead remote engineering teams
Guide the engineering team with the detailed ETL design to implement solution
Exceptional ability to effectively communicate with technical and business colleagues and make complex ideas understood
Experience working projects using Agile methodologies
Experience working with agile methodologies (Scrum, Kanban) and Meta Scrum with cross-functional teams (Product Owners, Scrum Master, Architects, and data SMEs)
