AI Inference Engineer QVAC (100% remote Worldwide) - remote job

Tether Operations Limited is hiring a AI Inference Engineer QVAC (100% remote Worldwide). The role sits in IT and programming and is fully remote. The company places no restriction on where the candidate lives, so you can apply from anywhere.

The employer did not publish a figure; that is settled at interview. The advert sets no condition on working hours.

This vacancy passed an automated check: the list excludes any advert requiring a foreign work permit, visa sponsorship, a particular citizenship, or residence in a specific country.

1. A 2-3 sentence summary of the role, in plain English. Develop and optimize the C++ systems layer for local AI inference, ensuring fast and reliable model performance on edge devices. This role involves working closely with researchers to deploy and integrate machine learning models, enhancing existing products with cutting-edge AI features.

2. What you will do: - Work on deploying machine learning models to edge devices using frameworks like llama.cpp and ggml - Collaborate with researchers to assist in coding, training, and transitioning models from research to production environments - Integrate AI features into existing products, enriching them with the latest advancements in machine learning - Ensure the inference layer is stable, optimized, and ready for integration with the rest of the stack

3. What they are looking for: - Strong programming skills in C++ - Experience with Llama.cpp and ggml inference engines - Experience with GPU frameworks such as Cuda, Vulkan, Metal, or OpenCL - Good understanding of deep learning concepts and model architectures - Experience with transformers, LLMs, and Diffusion models - Ability to rapidly assimilate new technologies and techniques - A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D - Bonus points for experience in training/fine-tuning LLMs, productionizing models, research experience in new model architectures, and experience with distributed systems - Javascript experience is a plus

4. Terms: - Pay: Not specified - Location: Remote - Hours: Not specified - Contract type: Not specified