---
GPU Accelerated Computing and Optimizations on Cross-Vendor Graphics Cards with Vulkan & Kompute - Alejandro Saucedo - CppCon 2022
Many advanced data processing paradigms fit incredibly well to the parallel-architecture that GPU computing offers, and exciting advancements in the open source projects such as the Vulkan SDK (a collection of tools for cross-vendor GPU development) and the Kompute Project (a Linux Foundation open source project that enables cross-vendor general-purpose GPU programming) are enabling developers to take advantage of general purpose GPU computing capabilities in cross-vendor mobile and desktop GPUs, including over 1000 GPUs across AMD, Qualcomm, NVIDIA & many more graphics processors. In this talk we will provide a conceptual and practical insight into the cross-vendor GPU compute ecosystem as well as how to adopt these tools to add GPU acceleration to your existing C applications.
In this talk we will show how you can write a simple GPU accelerated machine learning algorithm from scratch which will be able to run on virtually any GPU. We will give an overview on the projects that are making it possible to accelerate applications across cross-vendor GPUs. We’ll show how you can get started with the full power of your GPU using the Kompute framework with only a handful of lines of C code, as well as providing an intuition around how optimizations can be introduced through the lower level C interface.
As part of the more advanced example, we will showcase some optimizatiosn that can be leveraged through the hardware capabilities of relevant graphics cards, such as concurrency-enabled GPU queues which allow us to introduce 2x performance improvements into advanced data processing workloads. We will dive into the GPU computing terminology around asynchronous & parallel workflow processing, cover the core principles of data parallelism, explain the hardware concepts of GPU queues & queueFamilies, and talk about how advancements in new and upcoming graphics cards will enable for even bigger speedups (such as the more recent GPU architectures which will support 3 or now even more parallel queue processing workloads).
---
Alejandro Saucedo
Alejandro is the Chief Scientist at the Institute for Ethical AI & Machine Learning, where he contributes to policy and industry standards on the responsible design, development and operation of AI, including the fields of explainability, GPU acceleration, ML security and other key machine learning research areas. Alejandro Saucedo is Director of Engineering at Seldon Technologies, where he leads teams of machine learning engineers focused on the scalability and extensibility of machine learning deployment and monitoring products. With over 10 years of software development experience, Alejandro has held technical leadership positions across hyper-growth scale-ups and has a strong track record building cross-functional teams of software engineers. He is currently appointed as governing council Member-at-Large at the Association for Computing Machinery, and is currently the Chairperson of the GPU Acceleration Kompute Committee at the Linux Foundation.
LInkedin:
Twitter:
Github:
Website:
---
Videos Streamed & Edited by Digital Medium:
#cppcon #programming #gpu
1 view
206
85
3 weeks ago 00:07:06 1
Так вот где Боги живут. Смотри до конца | Сон Разума
3 weeks ago 00:21:46 1
DIY 7 идей декора дома, которые Вам не будут стоить ничего/ #diy IDEAS HOME DECOR
3 weeks ago 00:35:46 1
Эти цифры удивили даже привычных. Хватит прятаться от нас за спинами.
3 weeks ago 00:05:12 1
Депутаты Ахнули!🔥Генерал Шаманов в Госдуме🔥 Шокирующие подробности о бедственном положении армии!
3 weeks ago 00:04:42 1
Супер Беляши на Кефире! Очень вкусные, сочные, хрустящая корочка и пушистые внутри!
3 weeks ago 00:17:59 9
Исследование, о Котором Никто не Говорит | Связь музыки и ДНК
3 weeks ago 00:49:19 1
БОГ ЕСТЬ? Правда о Религии и Происхождении Человека
3 weeks ago 00:00:47 1
Чиновник посмеялся над волонтерами в Анапе
3 weeks ago 04:30:18 2
Волков – что происходит с ФБК / вДудь
3 weeks ago 00:10:33 1
Нашли допотопный чугунный мост , спрятанный в центре города
3 weeks ago 00:15:19 3
Что произошло, когда ОБНАРУЖИЛИ нацистские КОНЦЕНТРАЦИОННЫЕ ЛАГЕРЯ?
3 weeks ago 00:04:11 1
Ракета Искандер с воздушным подрывом рванула над КП танкового батальона в Яблоновка Сумской области
3 weeks ago 00:07:02 1
Торт Ферреро Роше тает во рту! Просто и очень вкусно!
3 weeks ago 00:12:28 1
Так Были КАЗНЕН1 Самые Жестокие Женщины НАЦИСТСКОГ0 Режима
3 weeks ago 00:09:58 2
Вот такой была ужасная ЖИЗНЬ СЕКСУАЛЬНЫХ РАБЫНЬ японской армии во 2-й Мировой войне
3 weeks ago 00:19:25 2
Три старейшие семьи управляют Ватиканом и планетой Земля. От них войны, эпидемии и голод.
3 weeks ago 00:09:56 7
Конец Религий Отчет Командования Аштара
3 weeks ago 00:53:15 1
Дарвин был не прав | Всё об эволюции
3 weeks ago 00:13:45 1
«Что Является Причиной Этих Быстрых Изменений» Команда Аштара
3 weeks ago 00:07:53 1
5 НОВЫХ СХЕМ МОШЕННИЧЕСТВА: как не стать жертвой?
3 weeks ago 00:00:56 2
Когда Володя у штурвала - ничего не страшно!
3 weeks ago 00:00:47 1
Бодрящий кофейно-арахисовый смузи к завтраку [Cheers! | Напитки]
4 weeks ago 00:58:23 3
Худший район Нью-Йорка, который мало кто видел: Железный треугольник