Senior AI / ML Engineer profile
Professional Profile

Senior AI / ML Engineer

12+ years experience6 roles11 certifications

This is a public version of my CV. For the latest role-tailored résumé, get in touch

About Me

Senior AI / ML Engineer with 12+ years of software and platform engineering experience, now focused on designing, building, and operating the platforms and infrastructure that run production AI/ML systems at scale. I bridge the gap between ML teams and reliable enterprise delivery — from GPU platforms and training orchestration to observable, cost-efficient inference serving.

My core expertise includes end-to-end ML platform design (feature stores, training orchestration, model registries, A/B serving), large language model integration and fine-tuning workflows (LoRA/QLoRA), retrieval-augmented generation (RAG) with advanced chunking, embedding and reranking strategies, and agentic AI system architecture with tool-use, planning, and memory patterns. I design AI platforms that are safe, explainable, and aligned with the EU AI Act, NIST AI RMF, and ISO/IEC 42001.

I architect scalable inference infrastructure on Kubernetes (GKE) with GPU scheduling, autoscaling, and cost-optimized serving using vLLM, TGI, and Triton. I have production experience with Vertex AI and working knowledge of Amazon SageMaker, Azure ML, and open-source stacks (MLflow, Kubeflow, Ray).

I can present complex AI system architecture clearly to executives, product teams, and regulators — with high-quality diagrams, risk assessments, and business-impact analysis. I lead architecture reviews, AI risk assessments, and implementation planning for responsible, scalable AI delivery.

Google Cloud (5x Professional Certified): Professional Cloud Architect, Professional Cloud Network Engineer, Professional Security Operations Engineer, Professional Cloud DevOps Engineer, Professional Data Engineer. Technical Expert: Build with Vertex, Intelligent Search, Customer Engagement Suite with Google AI.

As a published Technical Author, I actively share hands-on AI engineering insights on Medium and in professional publications, and have won multiple AI hackathons at Deutsche Telekom.

Contact

Email
LinkedIn profile linkLinkedIn
GitHub profile linkGitHub

Skills

Cloud & Platform
LLM Fine-Tuning (LoRA, QLoRA)
Retrieval-Augmented Generation (RAG)
Prompt Engineering & Evaluation (RAGAS, DeepEval)
Vector Databases (Pinecone, Weaviate, pgvector, ChromaDB)
Embedding Models & Semantic Search
ML Platform Architecture (Feature Store, Model Registry, A/B Serving)
Training Orchestration (Kubeflow, Ray, Vertex AI Pipelines)
Inference Serving (vLLM, TGI, Triton, TorchServe)
Model Optimization (Quantization, Distillation, Pruning)
Vertex AI (AutoML, Custom Training, Endpoints, Gemini)
Azure OpenAI Service & Azure ML
Data Engineering for ML (Spark, BigQuery, Dataflow, dbt)
Kubernetes (GKE, EKS)
Docker
Event-Driven Architecture (Kafka, Pub/Sub, NATS)
Security for AI Systems (Model Security, Data Poisoning Defense)
Security & Zero Trust
AI Governance (EU AI Act, NIST AI RMF, ISO/IEC 42001)
Delivery & IaC
Terraform / Pulumi
CI/CD (GitLab CI, GitHub Actions, Cloud Build)
Argo CD / Argo Workflows (GitOps, ML Pipelines)
Reliability & Observability
Observability (Prometheus, Grafana, OpenTelemetry)
Languages & Foundations
Transformer Architecture & Attention Mechanisms
Python (PyTorch, TensorFlow, JAX)
Go (Golang)
API Design (REST, gRPC, GraphQL, OpenAPI)
Architecture Diagramming & Technical Storytelling
Additional Expertise
Agentic AI (Tool-Use, Planning, Memory)
GPU Infrastructure & Scheduling (NVIDIA GPUs, MIG)
Amazon SageMaker & Bedrock
LangChain / LlamaIndex / CrewAI
Hugging Face Ecosystem (Transformers, PEFT, TRL, Datasets)
MLOps & Experiment Tracking (MLflow, W&B, Neptune)
Computer Vision (YOLO, ViT, Detectron2)
NLP (NER, Sentiment, Summarization, Classification)
Responsible AI & AI Safety (Guardrails, Red-Teaming, Bias Audit)
AI Risk Management (ISO/IEC 23894)

Experience

Senior Google Cloud Platform Engineer (GKE / GCP Focus)

T-Digital by Deutsche Telekom · Full-time

Sep 2024 - Present · 1 yr 11 mos

Thessaloniki, Central Macedonia, Greece · Hybrid

  • Extended the multi-region GKE platform to serve AI/ML workloads: provisioned GPU node pools with autoscaling, node taints/tolerations and scheduling policies for model inference and batch training jobs.
  • Enabled production model serving on Kubernetes (vLLM / Triton Inference Server) behind the platform L7 ingress and Cloud Armor, with HPA autoscaling, GPU-utilisation metrics and OpenTelemetry tracing.
  • Integrated Vertex AI into platform delivery: Terraform modules for endpoints and pipelines, Workload Identity access to Vertex services, and reproducible IaC for AI service deployment.
  • Owned and evolved a production multi-region, multi-cluster GKE platform serving multiple product teams: provisioned with Terraform (google/google-beta provider), managed via Argo CD GitOps across Standard and Autopilot cluster modes.
  • Designed and operated GCP networking: Shared VPC topology, Private Service Connect, VPC peering, private GKE clusters with authorised control-plane access, Cloud DNS private/public zone management.
  • Implemented HTTPS L7 ingress with Google-managed certificates, multi-backend routing via Cloud Load Balancing, and Cloud Armor WAF rules (rate limiting, geo-restriction, custom OWASP rule sets).
  • Hardened GCP IAM: Workload Identity Federation for keyless CI/CD authentication, least-privilege service account design, Org Policy constraints, Binary Authorization policy enforcement.
  • Operated GCP secrets and key management: Cloud KMS (CMEK), Secret Manager with rotation triggers, External Secrets Operator integration for seamless pod secret injection.
  • Built full-stack observability on GCP: Cloud Monitoring dashboards and SLO-based alerting, Cloud Logging with log-based metrics and Log Analytics, Cloud Trace integrated via OpenTelemetry collector.
  • Managed vulnerability pipeline: Artifact Registry container scanning, Trivy in CI, CVE triage process, Binary Authorization attestation gates to block unsigned images in production.
  • Improved platform resilience: cluster etcd backup to Cloud Storage, PVC snapshots, cross-region failover validation, RPO/RTO documentation aligned with SLO targets.

Selected Projects

  • AI Prompt Security

    A Chrome & Safari extension that keeps secrets out of AI prompts — it scans messages before they reach ChatGPT, Claude or Gemini using 110+ regex patterns plus Shannon-entropy analysis, then redacts or blocks API keys, tokens and PII. 100% local, zero telemetry.

    JavaScript · Chrome Extension · Safari Extension · Security · Privacy

    Chrome Web Store
  • Risk Analytics

    A quantitative model that gives leadership measurable visibility into key-person dependency, decision bottlenecks and human control-bypass risk — Bus Factor, Decision Concentration and Bypass Risk in one product. Published to PyPI with a citable DOI.

    Python · NetworkX · Risk Modeling · CLI · Research

    View on GitHub

Licenses & Certifications

Google8×

Google Cloud Certified Professional Cloud Architect

Issued by Google · Issued May 2025

Credential ID: 8a9ddfba001e4a55bf42667a6b62da9b

Skills: Cloud Solution Architecture, Security and Compliance, Cloud Networking, +6 more

Show credential

Google Cloud Certified Professional Data Engineer

Issued by Google · Issued Jan 2024

Credential ID: 4f3e7970bbdb4a61805a8209cfe215ed

Skills: Data Engineering, Big Data & ML Pipelines, Data Governance & Security, +6 more

Show credential

Courses

20265

NIS-2 Deep Dive

K&P Computer / BLUE Consult

Completion certificate for the NIS-2 Deep Dive web training (28 May 2026) covering real attack scenarios (identity theft, compromised backups, user account breaches), NIS-2 requirements including risk management, reporting obligations, and supply chain security, governance structures, security roles, policies, incident response processes, vulnerability management and cyber resilience with IBM solutions, network and firewall security, SOC/SIEM/endpoint protection, and identity/access/communication protection.

IBM DevOps and Software Engineering (Professional Certificate)

Coursera

ACE ID IBM-0032 (v1), 14 weeks (~200 hours), minimum passing score 70. ACE: 18 SH (6 x 3) across Web Development (HTML/CSS/JavaScript), Python for Data Science, Advanced Application Security, Intro to Cloud Computing, Intro to Python, and Microservices.

Education

  • Recognized in Germany · Bachelor level

    Military Academy of the Strategic Missile Forces Academy named after Peter the GreatEngineer's Degree, Automation Management Systems

    2007 - 2012

    Engineer's Degree, Automation Management Systems

    Engineer's Degree, Translation

    Recognized by the KMK Central Office for Foreign Education (ZAB) as equivalent to a German Bachelor's degree

    Time Management · Self-discipline · Communication and Collaboration

  • Humanitarian, Economic and Information Institute of TechnologyBachelor's Degree, Law

    2012 - 2016

    Bachelor's Degree, Law

    Data Privacy and Security · Compliance and Regulations · Communication and Collaboration · Technical Analysis

Publications

8articles published onGoogle Cloud - Community · Data Engineer Things · Medium · Mr. Plan ₿ Publication · Code Your Own Path

Latest

Google Cloud - CommunityMay 14, 2026

AI Security Evaluation: How to Test Prompt Injection, Data Leakage, and Unsafe Tool Calls

How to security-test LLM systems: red-teaming for prompt injection, detecting data leakage, and validating tool-call safety — building an AI security evaluation aligned with responsible AI.

Show publication
  1. How to Build AI Agents with ADK and Skills in 2026: From Prompts to Architecture

    Apr 18, 2026

    Google Cloud - Community

    Architecting agentic AI with the Agent Development Kit (ADK) and skills: tool use, planning, memory and orchestration patterns for moving from ad-hoc prompts to production-grade agents.

Honors and Awards

6distinctionsselected by Google & the developer community

  1. Issued by Google CloudJun 2026

    One of only a handful of engineers Google names Ambassador for Infrastructure — a recognition it reserves for the very top tier of its global Cloud community. Awarded for sustained, hands-on mastery of Google Cloud infrastructure, proven in the console rather than on paper.

  2. Issued by Google CloudMay 2026

    Recognised by Google as a Security Champion — a distinction given to practitioners who consistently demonstrate deep, applied expertise in securing Google Cloud environments and raising the security bar across the community.

    © 2026 Aleksei AleinikovSenior AI / ML Engineeralekseialeinikov.com