AMD Unveils AMD-135M: Compact AI Language Model

AMD has introduced the AMD-135M, a compact AI language mannequin. Constructed on Meta’s Llama framework, the AI is particularly designed for personal companies.

In a major transfer, the US-based tech big AMD unveiled the small language mannequin, named AMD-135M, at a current occasion. As a part of Meta’s “Llama” mannequin, the AMD-135M is anticipated to be broadly adopted by personal enterprises. The mannequin is available in two distinct variations: AMD-Llama-135M and AMD-Llama-135M-code. Based on AMD, the AMD-Llama-135M was skilled on 670 billion public information tokens, using 4 AMD Intuition MI250s through the coaching course of. The AMD-Llama-135M-code model, however, incorporates an extra 20 billion tokens particularly tailor-made for coding duties.

Might be optimized for particular duties

AMD’s small language fashions will be optimized and used for particular duties. Naturally, the AMD-Llama-135M-code can be primarily used for coding-related features. Based on AMD, the brand new language mannequin employs predictive decoding know-how, enabling the fashions to function at excessive velocity.

AMD additionally acknowledged that the AMD-135M continues to be in its early phases of improvement. The corporate plans to additional improve the small language mannequin sooner or later, aiming for higher leads to each efficiency and velocity. It stays to be seen if AMD, which is striving to determine itself within the synthetic intelligence sector, will obtain the success it seeks with its small language mannequin.