ZAZUMODELSBLOG

Model library · Mistral NeMo 12B · 2026-11-07

Telecom simulations

Tests reasoning through a phone diagnostic.

Allpassfailerror
21 simulations
TaskTrialResultEndedMessagesCost
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop98$0.009Transcript →
[mms_issue]break_app_storage_permission|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0passuser_stop120$0.017Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop69$0.007Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop94$0.010Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop78$0.008Transcript →
[mobile_data_issue]airplane_mode_on|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop47$0.004Transcript →
[mobile_data_issue]data_mode_off|data_usage_exceeded[PERSONA:None]0passuser_stop68$0.007Transcript →
[mobile_data_issue]data_saver_mode_on|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop106$0.014Transcript →
[service_issue]airplane_mode_on|break_apn_settings[PERSONA:Hard]0passuser_stop147$0.025Transcript →
[service_issue]airplane_mode_on|break_apn_settings|contract_end_suspension|lock_sim_card_pin|unseat_sim_card[PERSONA:Easy]0passuser_stop101$0.010Transcript →
[service_issue]airplane_mode_on|break_apn_settings|contract_end_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop96$0.011Transcript →
[service_issue]airplane_mode_on|break_apn_settings|lock_sim_card_pin|unseat_sim_card[PERSONA:None]0passuser_stop21$0.002Transcript →
[service_issue]airplane_mode_on|lock_sim_card_pin[PERSONA:Easy]0passuser_stop81$0.007Transcript →
[service_issue]airplane_mode_on|lock_sim_card_pin|overdue_bill_suspension[PERSONA:Easy]0passuser_stop24$0.002Transcript →
[service_issue]airplane_mode_on|lock_sim_card_pin|overdue_bill_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop68$0.007Transcript →
[service_issue]break_apn_settings|contract_end_suspension|lock_sim_card_pin[PERSONA:Hard]0passuser_stop42$0.004Transcript →
[service_issue]break_apn_settings|contract_end_suspension|lock_sim_card_pin|unseat_sim_card[PERSONA:Hard]0passuser_stop41$0.003Transcript →
[service_issue]break_apn_settings|lock_sim_card_pin|overdue_bill_suspension[PERSONA:Easy]0passuser_stop30$0.003Transcript →
[service_issue]break_apn_settings|lock_sim_card_pin|overdue_bill_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop80$0.009Transcript →
[service_issue]contract_end_suspension|lock_sim_card_pin[PERSONA:Hard]0passuser_stop50$0.006Transcript →
[service_issue]lock_sim_card_pin|overdue_bill_suspension[PERSONA:Easy]0passuser_stop24$0.003Transcript →