ZAZUMODELSBLOG

Model library · Mistral NeMo 12B · 2026-11-07

Telecom simulations

Tests reasoning through a phone diagnostic.

Allpassfailerror
114 simulations
TaskTrialResultEndedMessagesCost
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Hard]0failmax_steps202$0.024Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0failmax_steps204$0.025Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]0failtoo_many_errors47$0.005Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:None]0failuser_stop62$0.005Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]0failtoo_many_errors140$0.043Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]0failuser_stop12$0.001Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]0failmax_steps204$0.025Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0failuser_stop50$0.004Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]0failuser_stop48$0.004Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:None]0failuser_stop66$0.005Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]0failuser_stop6$0.000Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_app_storage_permission|unseat_sim_card[PERSONA:Hard]0failuser_stop48$0.005Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0failmax_steps204$0.025Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]0failmax_steps204$0.029Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_storage_permission[PERSONA:None]0failtoo_many_errors44$0.005Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_mode_off|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]0failuser_stop40$0.004Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_usage_exceeded[PERSONA:Hard]0failmax_steps206$0.029Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0failmax_steps204$0.028Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_storage_permission|data_mode_off|user_abroad_roaming_enabled_off[PERSONA:Easy]0failtoo_many_errors60$0.006Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|data_usage_exceeded[PERSONA:None]0failuser_stop30$0.003Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]0failuser_stop58$0.006Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|user_abroad_roaming_enabled_off[PERSONA:Easy]0failuser_stop66$0.007Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions[PERSONA:Hard]0failmax_steps202$0.028Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]0failtoo_many_errors115$0.013Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]0failuser_stop60$0.005Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:None]0failuser_stop22$0.002Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]0failmax_steps206$0.023Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]0failmax_steps204$0.028Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]0failuser_stop22$0.002Transcript →
[mms_issue]bad_network_preference|break_app_both_permissions[PERSONA:Easy]0failmax_steps204$0.027Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]0failuser_stop22$0.002Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|user_abroad_roaming_disabled_on[PERSONA:Hard]0failuser_stop21$0.002Transcript →
[mms_issue]bad_network_preference|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:None]0failtoo_many_errors74$0.007Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop98$0.009Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_on[PERSONA:None]0failuser_stop38$0.004Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]0failuser_stop42$0.003Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_usage_exceeded[PERSONA:Hard]0failuser_stop38$0.004Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:None]0failtoo_many_errors46$0.003Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]0failuser_stop22$0.002Transcript →
[mms_issue]bad_wifi_calling|data_mode_off|data_usage_exceeded[PERSONA:Easy]0failuser_stop60$0.009Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:Hard]0failuser_stop49$0.005Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:Hard]0failuser_stop27$0.003Transcript →
[mms_issue]break_apn_mms_setting|user_abroad_roaming_enabled_off[PERSONA:Hard]0failuser_stop36$0.004Transcript →
[mms_issue]break_app_both_permissions|data_usage_exceeded[PERSONA:Hard]0failuser_stop91$0.007Transcript →
[mms_issue]break_app_both_permissions|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0failuser_stop64$0.009Transcript →
[mms_issue]break_app_sms_permission|data_mode_off[PERSONA:None]0failuser_stop44$0.005Transcript →
[mms_issue]break_app_sms_permission|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]0failtoo_many_errors50$0.005Transcript →
[mms_issue]break_app_storage_permission|data_usage_exceeded[PERSONA:Easy]0failmax_steps202$0.026Transcript →
[mms_issue]break_app_storage_permission|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0passuser_stop120$0.017Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference[PERSONA:Hard]0failuser_stop12$0.002Transcript →
Page 1 of 3Next →