ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Telecom simulations

Tests reasoning through a phone diagnostic.

Allpassfailerror
444 simulations
TaskTrialResultEndedMessagesCost
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:None]3passuser_stop86$0.093Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]0passuser_stop94$0.100Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]1passuser_stop72$0.070Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]2passuser_stop88$0.096Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]3passuser_stop66$0.064Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop106$0.116Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]1passuser_stop80$0.059Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]2passuser_stop96$0.081Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]3passuser_stop92$0.071Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]0passuser_stop72$0.080Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]1passuser_stop76$0.091Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]2passuser_stop74$0.106Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]3passuser_stop68$0.085Transcript →
[mms_issue]bad_network_preference|break_app_both_permissions[PERSONA:Easy]0passuser_stop60$0.058Transcript →
[mms_issue]bad_network_preference|break_app_both_permissions[PERSONA:Easy]1passuser_stop62$0.060Transcript →
[mms_issue]bad_network_preference|break_app_both_permissions[PERSONA:Easy]2passuser_stop48$0.045Transcript →
[mms_issue]bad_network_preference|break_app_both_permissions[PERSONA:Easy]3passuser_stop54$0.057Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop96$0.095Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]1passuser_stop80$0.088Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]2passuser_stop76$0.079Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]3passuser_stop96$0.111Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop56$0.056Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|user_abroad_roaming_disabled_on[PERSONA:Hard]1passuser_stop46$0.044Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|user_abroad_roaming_disabled_on[PERSONA:Hard]2passuser_stop58$0.064Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|user_abroad_roaming_disabled_on[PERSONA:Hard]3passuser_stop52$0.050Transcript →
[mms_issue]bad_network_preference|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop30$0.026Transcript →
[mms_issue]bad_network_preference|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:None]1passuser_stop36$0.037Transcript →
[mms_issue]bad_network_preference|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:None]2passuser_stop66$0.063Transcript →
[mms_issue]bad_network_preference|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:None]3passuser_stop30$0.024Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop58$0.053Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_off[PERSONA:None]1passuser_stop62$0.069Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_off[PERSONA:None]2passuser_stop60$0.062Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_off[PERSONA:None]3passuser_stop70$0.070Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop30$0.026Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_on[PERSONA:None]1passuser_stop30$0.022Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_on[PERSONA:None]2passuser_stop68$0.066Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_on[PERSONA:None]3passuser_stop54$0.051Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop82$0.074Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]2passuser_stop106$0.129Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]3passuser_stop82$0.092Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_usage_exceeded[PERSONA:Hard]0passuser_stop76$0.073Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_usage_exceeded[PERSONA:Hard]1passuser_stop70$0.054Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_usage_exceeded[PERSONA:Hard]2passuser_stop80$0.080Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_usage_exceeded[PERSONA:Hard]3passuser_stop82$0.093Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:None]0passuser_stop92$0.089Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:None]2passuser_stop85$0.078Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:None]3passuser_stop88$0.085Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop60$0.064Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]1passuser_stop66$0.045Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]2passuser_stop74$0.058Transcript →