{"id":623,"count":0,"description":"<h2>AI servers: what hardware is needed for neural networks<\/h2>\n<p>The division brings together equipment for artificial intelligence\u2014from camera modules to servers for eight accelerators:<\/p>\n<ul>\n<li><strong>GPU platforms and GPU servers<\/strong> \u2014 training and inference models on NVIDIA A100, H100, H200, B200, B300 and AMD Instinct GPUs, as well as machines on 1\u20134 video cards and used servers;<\/li>\n<li><strong>AI supercomputers<\/strong> \u2014 desktop stations on NVIDIA GB10 with 128 GB of total memory and on GB300;<\/li>\n<li><strong>Edge servers and AI modules from SOPHGO<\/strong> \u2014 video analytics near the cameras when power consumption is 12.5 W;<\/li>\n<li><strong>RISC-V servers<\/strong> \u2014 calculations and data storage on open-architecture processors.<\/li>\n<\/ul>\n<p>Start with the model size: it determines how much memory the accelerators will need. Then consider the software stack \u2014 CUDA from NVIDIA, ROCm from AMD \u2014 and the power your server can handle. If the required configuration isn\u2019t in the catalog, <a href=\"https:\/\/cluster-mining.com\/en\/contacts\/\">The manager will choose the right one for the task.<\/a>.<\/p>\n<h3>Frequently asked questions<\/h3>\n<h4>How are GPU platforms different from GPU servers in the catalog?<\/h4>\n<p>GPU platforms are equipped with servers with 6\u20138 accelerators from Supermicro, ASRock Rack, GIGABYTE, ASUS, HPE, and Dell. There are both machines with one or four video cards and tower configurations as well as used servers in the GPU servers.<\/p>\n<h4>How much accelerator memory is needed for LLM?<\/h4>\n<p>In the FP16 format, the model takes up about 2 GB per billion parameters; in 4-bit quantization, it takes about 0.5\u20130.6 GB; plus a buffer for context. Models with 70 billion parameters in FP16 require about 140 GB, that is, at least two accelerators of 80\u201396 GB each.<\/p>\n<h4>Which server should I use for training, and which for inference?<\/h4>\n<p>For training large models, servers with 8 SXM accelerators with NVLink connectivity\u2014H100, H200, B200, or B300\u2014are used. For inference and pre-training, 2\u20138 PCIe cards are often sufficient, such as the RTX PRO 6000 with 96 GB of memory.<\/p>","link":"https:\/\/cluster-mining.com\/en\/catalog\/ai-servers\/","name":"AI servers","slug":"ai-servers","taxonomy":"product_cat","parent":0,"meta":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>\u041a\u0443\u043f\u0438\u0442\u044c AI- \u0438 GPU-\u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441\u0430<\/title>\n<meta name=\"description\" content=\"AI \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0438 GPU \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u0437\u0430\u0434\u0430\u0447 \u0438\u0441\u043a\u0443\u0441\u0441\u0442\u0432\u0435\u043d\u043d\u043e\u0433\u043e \u0438\u043d\u0442\u0435\u043b\u043b\u0435\u043a\u0442\u0430: \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u0435 \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441. \u041a\u043e\u043d\u0444\u0438\u0433\u0443\u0440\u0430\u0446\u0438\u0438, \u043e\u0431\u043e\u0440\u0443\u0434\u043e\u0432\u0430\u043d\u0438\u0435 \u0438 \u0440\u0435\u0448\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0431\u0438\u0437\u043d\u0435\u0441\u0430.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cluster-mining.com\/en\/catalog\/ai-servers\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"\u041a\u0443\u043f\u0438\u0442\u044c AI- \u0438 GPU-\u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441\u0430\" \/>\n<meta property=\"og:description\" content=\"AI \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0438 GPU \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u0437\u0430\u0434\u0430\u0447 \u0438\u0441\u043a\u0443\u0441\u0441\u0442\u0432\u0435\u043d\u043d\u043e\u0433\u043e \u0438\u043d\u0442\u0435\u043b\u043b\u0435\u043a\u0442\u0430: \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u0435 \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441. \u041a\u043e\u043d\u0444\u0438\u0433\u0443\u0440\u0430\u0446\u0438\u0438, \u043e\u0431\u043e\u0440\u0443\u0434\u043e\u0432\u0430\u043d\u0438\u0435 \u0438 \u0440\u0435\u0448\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0431\u0438\u0437\u043d\u0435\u0441\u0430.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cluster-mining.com\/en\/catalog\/ai-servers\/\" \/>\n<meta property=\"og:site_name\" content=\"\u041c\u0430\u0439\u043d\u0438\u043d\u0433 \u041a\u043b\u0430\u0441\u0442\u0435\u0440\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cluster-mining.com\/wp-content\/uploads\/2025\/11\/homepage-banner_cover.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"CollectionPage\",\"@id\":\"https:\/\/cluster-mining.com\/catalog\/ai-servers\/\",\"url\":\"https:\/\/cluster-mining.com\/catalog\/ai-servers\/\",\"name\":\"\u041a\u0443\u043f\u0438\u0442\u044c AI- \u0438 GPU-\u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441\u0430\",\"isPartOf\":{\"@id\":\"https:\/\/cluster-mining.com\/#website\"},\"description\":\"AI \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0438 GPU \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u0437\u0430\u0434\u0430\u0447 \u0438\u0441\u043a\u0443\u0441\u0441\u0442\u0432\u0435\u043d\u043d\u043e\u0433\u043e \u0438\u043d\u0442\u0435\u043b\u043b\u0435\u043a\u0442\u0430: \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u0435 \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441. \u041a\u043e\u043d\u0444\u0438\u0433\u0443\u0440\u0430\u0446\u0438\u0438, \u043e\u0431\u043e\u0440\u0443\u0434\u043e\u0432\u0430\u043d\u0438\u0435 \u0438 \u0440\u0435\u0448\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0431\u0438\u0437\u043d\u0435\u0441\u0430.\",\"breadcrumb\":{\"@id\":\"https:\/\/cluster-mining.com\/catalog\/ai-servers\/#breadcrumb\"},\"inLanguage\":\"en-US\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/cluster-mining.com\/catalog\/ai-servers\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430\",\"item\":\"https:\/\/cluster-mining.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI\u2011\u0441\u0435\u0440\u0432\u0435\u0440\u044b\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/cluster-mining.com\/#website\",\"url\":\"https:\/\/cluster-mining.com\/\",\"name\":\"\u041c\u0430\u0439\u043d\u0438\u043d\u0433 \u041a\u043b\u0430\u0441\u0442\u0435\u0440\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/cluster-mining.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"\u041a\u0443\u043f\u0438\u0442\u044c AI- \u0438 GPU-\u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441\u0430","description":"AI servers and GPU servers for artificial intelligence tasks: neural network training, LLMs, and inference. Configurations, hardware, and business solutions.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cluster-mining.com\/en\/catalog\/ai-servers\/","og_locale":"en_US","og_type":"article","og_title":"\u041a\u0443\u043f\u0438\u0442\u044c AI- \u0438 GPU-\u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441\u0430","og_description":"AI \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0438 GPU \u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u0437\u0430\u0434\u0430\u0447 \u0438\u0441\u043a\u0443\u0441\u0441\u0442\u0432\u0435\u043d\u043d\u043e\u0433\u043e \u0438\u043d\u0442\u0435\u043b\u043b\u0435\u043a\u0442\u0430: \u043e\u0431\u0443\u0447\u0435\u043d\u0438\u0435 \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441. \u041a\u043e\u043d\u0444\u0438\u0433\u0443\u0440\u0430\u0446\u0438\u0438, \u043e\u0431\u043e\u0440\u0443\u0434\u043e\u0432\u0430\u043d\u0438\u0435 \u0438 \u0440\u0435\u0448\u0435\u043d\u0438\u044f \u0434\u043b\u044f \u0431\u0438\u0437\u043d\u0435\u0441\u0430.","og_url":"https:\/\/cluster-mining.com\/en\/catalog\/ai-servers\/","og_site_name":"\u041c\u0430\u0439\u043d\u0438\u043d\u0433 \u041a\u043b\u0430\u0441\u0442\u0435\u0440","og_image":[{"width":1920,"height":1080,"url":"https:\/\/cluster-mining.com\/wp-content\/uploads\/2025\/11\/homepage-banner_cover.jpeg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"CollectionPage","@id":"https:\/\/cluster-mining.com\/catalog\/ai-servers\/","url":"https:\/\/cluster-mining.com\/catalog\/ai-servers\/","name":"\u041a\u0443\u043f\u0438\u0442\u044c AI- \u0438 GPU-\u0441\u0435\u0440\u0432\u0435\u0440\u044b \u0434\u043b\u044f \u043d\u0435\u0439\u0440\u043e\u0441\u0435\u0442\u0435\u0439, LLM \u0438 \u0438\u043d\u0444\u0435\u0440\u0435\u043d\u0441\u0430","isPartOf":{"@id":"https:\/\/cluster-mining.com\/#website"},"description":"AI servers and GPU servers for artificial intelligence tasks: neural network training, LLMs, and inference. Configurations, hardware, and business solutions.","breadcrumb":{"@id":"https:\/\/cluster-mining.com\/catalog\/ai-servers\/#breadcrumb"},"inLanguage":"en-US"},{"@type":"BreadcrumbList","@id":"https:\/\/cluster-mining.com\/catalog\/ai-servers\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u0413\u043b\u0430\u0432\u043d\u0430\u044f \u0441\u0442\u0440\u0430\u043d\u0438\u0446\u0430","item":"https:\/\/cluster-mining.com\/"},{"@type":"ListItem","position":2,"name":"AI\u2011\u0441\u0435\u0440\u0432\u0435\u0440\u044b"}]},{"@type":"WebSite","@id":"https:\/\/cluster-mining.com\/#website","url":"https:\/\/cluster-mining.com\/","name":"Mining Cluster","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cluster-mining.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/cluster-mining.com\/en\/wp-json\/wp\/v2\/product_cat\/623","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cluster-mining.com\/en\/wp-json\/wp\/v2\/product_cat"}],"about":[{"href":"https:\/\/cluster-mining.com\/en\/wp-json\/wp\/v2\/taxonomies\/product_cat"}],"wp:post_type":[{"href":"https:\/\/cluster-mining.com\/en\/wp-json\/wp\/v2\/product?product_cat=623"}],"curies":[{"name":"WP","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}