Domains & Rubric Philosophy
Mahak covers five domains open for contributions at launch, plus upcoming domains.
Open Domains
Legal Contracts
Drafting and reviewing contract clauses in sound legal language. Tasks include drafting termination clauses, defining responsibilities, and flagging legal loopholes.
Creative Writing
Stories, narrative, dialogue, and literary texts in formal and colloquial Arabic. Evaluation covers fluency, stylistic integrity, and adherence to artistic constraints.
Customer Support
Responses, apologies, and problem-solving in a professional yet friendly tone. Tasks include replying to customer complaints, drafting formal apologies, and offering practical solutions.
Business Communication
Formal letters, proposals, and negotiation in business Arabic. Tasks include drafting formal responses to price quotes, negotiation letters, and corporate correspondence.
Instruction Following
Strict adherence to constraints: structured formats, line counts, and precise specifications. Evaluates a model’s ability to follow instructions exactly without additions or omissions.
Upcoming Domains
Translation, summarization, and linguistic review — will open for contributions gradually.
Rubric Philosophy
Each prompt comes with clear rubric criteria divided into:
- Positive criteria: what the output should contain (e.g., formal polite tone, word count adherence).
- Negative criteria: what the output should not contain (e.g., no English phrases, no exceeding word limits).
Each criterion has a weight determining its relative importance. Criteria are classified by evidence type: linguistic rule, contract fact, negative constraint, or formatting.