Lead GPU Engineer

KOG: Kog is a European VC-funded startup and real-time AI frontier lab building the world’s fastest AI execution layer. As part of the 2030 French Tech cohort, we are on a mission to redefine the boundaries of artificial intelligence by enabling true real-time interaction at a scale never seen before. While the industry often settles for incremental software updates, we are engineering a radical, vertically integrated solution. Our approach is built on three deeply interconnected streams that form the core of our competitive advantage: GPU Engineering: We are building the Kog Inference Engine, a proprietary runtime purpose-built for Dense and MoE LLMs. We develop our own kernels directly in Assembly on AMD Instinct accelerators, entirely bypassing standard libraries to extract the theoretical maximum throughput from the hardware. Model Architecture: We do not just run models; we reinvent them. Our researchers design model architectures specifically optimized for our engine, creating a hardware-software co-design loop that enables massive performance leaps. Product & Software Engineering: We prove our technology through extreme use cases, starting with high-performance software engineering to power real-time generative video games directly in the web browser. Why join now? We aim to achieve 100x faster token generation compared to current industry standards, targeting 10,000+ tokens per second to unlock truly instantaneous AI. We have already achieved a 3x to 10x speed increase over leading alternatives (vLLM, TensorRT-LLM) through breakthroughs in: Inter-GPU communication and grid synchronization: Redefining how chips communicate within a cluster. Aggressive kernel fusion: Merging complex operations to minimize memory round-trips. Low-level memory access optimization: Fine-tuning the hardware's memory hierarchy. Continuous memory streaming: Eliminating bottlenecks for zero-latency execution. Speed-of-light MatMul kernels: Writing raw assembly to outperform vendor libraries. Our work is recognized by industry leaders, as evidenced by our recent performance benchmark, which was published on AMD’s official blog. The Culture: You will join a high-intensity environment where we prioritize shipping over talking and technical truth over corporate consensus. At Kog, you will not just be an engineer, you will be a pioneer building the foundational infrastructure for the next generation of collaborative, real-time AI agents. What You'll Do: We are seeking a Lead GPU Engineer with strong managerial experience or senior expertise to act as a strategic partner to the CEO. You will bridge the gap between high-level architectural vision and concrete execution, turning ambitious ideas into a production-ready reality. Your role is a hybrid of high-impact technical leadership and hands-on engineering. You will be expected to: 1/ Technical Strategy & Execution (The "Owner") Own the Roadmap: Take high-level directions and abstract concepts from the CEO to define concrete objectives and convert them into a structured, actionable technical roadmap. Architect the 10x leap: Lead the engineering efforts to optimize the Kog inference engine, aiming to surpass current state-of-the-art solutions by an order of magnitude. Hardware-Software Co-design: Collaborate deeply with the Model Architecture stream to influence model design. You will provide the feedback loop that allows researchers to structure models specifically to exploit your latest kernel optimizations and memory hierarchy breakthroughs. Accountability: You are fully accountable for the delivery. You ensure that we don't just have a plan, but that we execute it with precision. 2/ Hands-on Engineering (The "Expert") Strategic Contribution: You are capable of diving into the code to unblock the team or tackle critical optimizations when necessary. Lead by example: You maintain a deep understanding of the codebase to conduct low-level code reviews and both macro and micro decisions, ensuring quality without being the bottleneck. Deep-dive optimization: Spearhead the reverse-engineering of subtle AMD GPU features (memory page mappings and hashing functions, L2 and L3 cache behaviors, wavefront scheduling, register file exploitation, etc.) to unlock raw performance. System-level creativity: Leverage your deep understanding of GPU hardware and AI algorithms to find and implement creative optimization strategies that junior engineers might miss. 3/ Team Leadership & Culture (The "Captain") Manage and Coach: Manage a team of brilliant engineers and PhDs. Whether you are an experienced manager or a senior expert stepping up, your goal is to foster a culture of technical excellence and "no-ego" collaboration. Efficient Communication: You promote a culture of deep work and asynchronous communication to minimize interruptions while keeping the team aligned. Entrepreneurial Ownership: Act not just as an employee, but as a builder of the company. Make decisions that prioritize the startup’s long-term success, velocity, and scalability. Whom we'd like to work with: We are seeking a unique profile: a deeply technical engineer who enjoys the craft of coding, but also possesses the maturity to lead a team and develop a roadmap. You are a "force multiplier" and make everyone around you better. 1/ Technical Expertise: Low-Level Authority: You have experience in modern C++ and Assembly. You are comfortable working close to the metal. GPU Intimacy: You understand exactly how GPUs work under the hood (memory hierarchy, cache coherency, thread scheduling). You are familiar with NVIDIA (CUDA/PTX) and/or AMD (ROCm/HIP/CDNA) architectures. Optimization Obsession: You have a proven track record of extracting every ounce of performance from hardware. You know how to use profilers and debuggers to solve complex bottlenecks. 2/ Leadership & Accountability: Transform Directions into Concrete Plans: You can take high-level, sometimes abstract scientific directives and turn them into a concrete, executed engineering plan. Flexible Experience Level: Option A: You are already an Engineering Manager / Tech Lead with experience managing a high-performance team. Option B: You are a Senior/Staff Engineer at a top-tier tech company, looking to take the next step in your career and shoulder managerial responsibilities. Delivery Focus: You prioritize shipping. You understand the trade-offs between "perfect code" and "market timing." 3/ Mindset: Superstar without the Ego: You are confident in your skills but humble in your interactions. You are hands-on and willing to do the "grunt work" when necessary. Entrepreneurial Drive: You treat the company as if it were your own. You are resilient, adaptable, and motivated by the ambition of building a European AI giant. Curiosity: You are not afraid of the unknown. If the documentation doesn't exist, you reverse-engineer it. What we offer: Top-Tier Compensation: We offer a highly competitive salary package (top of the market) tailored to match your expertise and leadership level. Real Ownership (BSPCE): You aren't just an employee; you are a partner. We offer significant equity to ensure you share in the startup's success. Unrivaled Technical Playground: Work on the bleeding edge of AI hardware. You will have access to the compute power you need (high-end clusters) to perform your magic. A world-class Environment: Join a high-density talent team of 12 engineers (including 5 PhDs). We value peer-to-peer learning, high autonomy, and zero bureaucracy. Impact & Autonomy: As a Lead, you will have a direct seat at the table to shape our engineering culture and roadmap alongside the CEO. Remote-First & Team Bonding: We operate as a remote-first company, valuing autonomy and deep work. Our culture is punctuated by our monthly "Paris Weeks" one week per month, where the whole team gathers at our WeWork offices in the 13th district (near Station F), the heart of Paris' tech scene. These weeks are dedicated to strategic alignment, intense collaboration, and team bonding. Ready to build the 10,000+ tokens/sec engine? Apply directly to start the conversation #J-18808-Ljbffr