Mahak is an open community platform measuring the true language competence of AI models in Arabic: fluency, dialects, cultural context, and instruction adherence.

The idea

A contributor copies a ready-made prompt, runs it in any AI model they use, then uploads the output. The community evaluates submissions with multi-dimensional reaction tags (accuracy, style, instruction adherence…) plus upvotes and downvotes, driving continuous Arena and Matrix rankings.

Why the name “Mahak”? Etymology & Historical Philology

The name Mahak (مَحَكّ / مِحَكّ) represents a profound convergence of two ancient Arabic concepts documented across classical Arabic heritage and mapped extensively by the Doha Historical Dictionary of Arabic (معجم الدوحة التاريخي للغة العربية):

1. “Al-Mihakk” (The Touchstone of Assay — Root: ḥ-k-k)

In its material heritage origin (attested since at least 330 AH / 941 CE), Al-Mihakk is the fine-grained silicious stone (the goldsmith’s touchstone) against which gold and silver are rubbed to assay purity, separating pure metal from spurious gilded brass. As documented in Al-Jawharatayn al-‘Atiqatayn by classical polymath Al-Hasan ibn Ahmad al-Hamdani (330 AH / 941 CE, d. 334 AH / 946 CE):

“When the assay master is satisfied with the touchstone (al-mihakk), he thins the folios and expands them on the anvil with the hammer…”

Over the centuries, the term evolved from literal metallurgy into philosophical discernment: Mihakk an-Nazar (the Touchstone of Rational Scrutiny) — reason’s instrument for distinguishing genuine truth from sophistry. Classical scholar Abu Mansur ath-Tha‘alibi (387 AH / 997 CE, d. 429 AH / 1038 CE) wrote: “They were exposed to the touchstone of scrutiny (mihakk al-i‘tibar)”; Ali ibn al-Hasan al-Bakharzi (464 AH / 1071 CE, d. 467 AH / 1075 CE) proclaimed: “I peel away texts with the touchstone of examination line by line”; Imam Abu al-Qasim al-Qushayri (434 AH / 1042 CE, d. 465 AH / 1072 CE) stated: “A person’s touchstone is the sign that reveals their true essence”; and philosopher Abu Hayyan al-Tawhidi (d. 414 AH / 1023 CE) examined the concept of fundamental criteria in inquiry.

2. “Mumahaka” & The Root m-ḥ-k (Relentless Adversarial Scrutiny)

Simultaneously, the Semitic root (m-ḥ-k) reaches deep into ancient South Semitic cognates (Mehri: m-ḥ-ḳ / mǝḥāḳ, Jibbali: maḥáḳ / s̃ĩḥaḳ, Harsusi: meḥāḳ, signifying uncompromising perseverance and disputation) and early classical Arabic, meaning relentless thoroughness, rigorous cross-examination, and refusal to concede to superficiality during bartering or judgment.

The Doha Historical Dictionary records the earliest pre-Islamic witness circa 150 years before the Hijra (~150 BH / ~476 CE) in the eloquence of Hind bint al-Khuss al-Iyadiah:

“Uphold the deeds of the noble and their gentleness … and be not contentious, stubbornly persisting in dispute (tamḥaku).”

Hashim ibn Abd Manaf (~100 BH / ~525 CE) warned: “Whoever is driven by stubborn dispute (al-lajaj) is led to injustice”; pre-Islamic poet Zuhayr ibn Abi Sulma (~13 BH / ~609 CE) urged: “Do not gamble your honor in obstinate dispute”; and Hatim al-Ta’i (~13 BH / ~609 CE) attested to clear communication free of obstinacy. Imam Ali ibn Abi Talib codified this in his instructions to his governor (37 AH / 657 CE): “[Choose one] whom disputes do not wear down (la tamḥakuhu al-khusum), and who does not persist in error.” Classical lexicographers Al-Khalil ibn Ahmad (d. 175 AH / 791 CE), Sibawayh (d. 180 AH / 796 CE), and Ibn Faris (d. 395 AH / 1004 CE) defined the root as unyielding persistence, culminating in Al-Mutanabbi’s verse (354 AH / 965 CE): “Uncompromising (maḥik) when a debtor delays payment…”.

The Convergence in the Mahak Benchmark

The Mahak Benchmark unites both dimensions: it is an unyielding touchstone separating genuine Arabic mastery from superficial machine-translated veneer, and an adversarial testing ground that relentlessly examines models on syntax, morphology, cultural context, and strict instruction following.

Lexicographical Citations:

Principles

Arabic first: every prompt is natively Arabic — no machine translation, no intermediaries.
Practical, not academic: everyday tasks anyone can understand.
Full transparency: results are shown as-is, and the methodology is open to everyone.

About Mahak