ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Telecom simulations

Tests reasoning through a phone diagnostic.

Allpassfailerror
456 simulations
TaskTrialResultEndedMessagesCost
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]2passuser_stop78$0.042Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]3passuser_stop78$0.052Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop96$0.097Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]1passuser_stop89$0.096Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]2passuser_stop94$0.108Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]3passuser_stop96$0.119Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_storage_permission[PERSONA:None]0passuser_stop50$0.045Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_storage_permission[PERSONA:None]1passuser_stop62$0.058Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_storage_permission[PERSONA:None]2passuser_stop60$0.057Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_storage_permission[PERSONA:None]3passuser_stop58$0.058Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_mode_off|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]0passuser_stop70$0.074Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_mode_off|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]1passuser_stop66$0.043Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_mode_off|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]2passuser_stop66$0.040Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_mode_off|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]3passuser_stop62$0.041Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_usage_exceeded[PERSONA:Hard]0passuser_stop74$0.074Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_usage_exceeded[PERSONA:Hard]1passuser_stop82$0.085Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_usage_exceeded[PERSONA:Hard]2passuser_stop70$0.074Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_usage_exceeded[PERSONA:Hard]3passuser_stop66$0.071Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop84$0.084Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]1passuser_stop70$0.073Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]2passuser_stop82$0.077Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]3passuser_stop96$0.107Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_storage_permission|data_mode_off|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop62$0.058Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_storage_permission|data_mode_off|user_abroad_roaming_enabled_off[PERSONA:Easy]1passuser_stop60$0.041Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_storage_permission|data_mode_off|user_abroad_roaming_enabled_off[PERSONA:Easy]2passuser_stop64$0.050Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_storage_permission|data_mode_off|user_abroad_roaming_enabled_off[PERSONA:Easy]3passuser_stop56$0.035Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|data_usage_exceeded[PERSONA:None]0passuser_stop60$0.056Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|data_usage_exceeded[PERSONA:None]1passuser_stop54$0.047Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|data_usage_exceeded[PERSONA:None]2passuser_stop92$0.101Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|data_usage_exceeded[PERSONA:None]3passuser_stop58$0.050Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop96$0.092Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]1passuser_stop104$0.117Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]2passuser_stop100$0.114Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]3passuser_stop108$0.127Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop52$0.057Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|user_abroad_roaming_enabled_off[PERSONA:Easy]1passuser_stop52$0.031Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|user_abroad_roaming_enabled_off[PERSONA:Easy]2passuser_stop54$0.039Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|user_abroad_roaming_enabled_off[PERSONA:Easy]3passuser_stop52$0.032Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions[PERSONA:Hard]0passuser_stop50$0.057Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions[PERSONA:Hard]1passuser_stop54$0.055Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions[PERSONA:Hard]2passuser_stop54$0.054Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions[PERSONA:Hard]3passuser_stop38$0.033Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop86$0.076Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]1passuser_stop86$0.091Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]2passuser_stop66$0.065Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]3passuser_stop58$0.055Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]0failuser_stop102$0.106Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]1passuser_stop104$0.104Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]2passuser_stop110$0.111Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]3passuser_stop90$0.090Transcript →