ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-28

Telecom simulations

Tests reasoning through a phone diagnostic.

Allpassfailerror
113 simulations
TaskTrialResultEndedMessagesCost
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Hard]0passuser_stop107$0.035Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop112$0.034Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]0passuser_stop103$0.030Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop124$0.041Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop120$0.031Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]0passuser_stop112$0.034Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]0passuser_stop92$0.029Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0passuser_stop92$0.024Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]0passuser_stop122$0.035Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop102$0.029Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]0passuser_stop86$0.026Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|break_app_storage_permission|unseat_sim_card[PERSONA:Hard]0passuser_stop60$0.017Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|bad_wifi_calling|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0passuser_stop82$0.025Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop90$0.024Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|break_app_storage_permission[PERSONA:None]0passuser_stop72$0.020Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_mode_off|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:Easy]0passuser_stop84$0.024Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_apn_mms_setting|data_usage_exceeded[PERSONA:Hard]0passuser_stop68$0.020Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop68$0.020Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|break_app_storage_permission|data_mode_off|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop70$0.017Transcript →
[mms_issue]airplane_mode_on|bad_network_preference|data_usage_exceeded[PERSONA:None]0passuser_stop56$0.017Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|break_app_both_permissions|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop96$0.030Transcript →
[mms_issue]airplane_mode_on|bad_wifi_calling|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop68$0.020Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions[PERSONA:Hard]0passuser_stop62$0.016Transcript →
[mms_issue]airplane_mode_on|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop74$0.020Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_apn_mms_setting|break_app_storage_permission|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:Easy]0passuser_stop98$0.028Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop103$0.032Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_both_permissions|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]0passuser_stop100$0.029Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|data_usage_exceeded|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop76$0.025Transcript →
[mms_issue]bad_network_preference|bad_wifi_calling|break_app_sms_permission|data_mode_off|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Hard]0passuser_stop118$0.036Transcript →
[mms_issue]bad_network_preference|break_app_both_permissions[PERSONA:Easy]0passuser_stop58$0.015Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|data_mode_off|data_usage_exceeded|user_abroad_roaming_enabled_off[PERSONA:None]0passuser_stop74$0.023Transcript →
[mms_issue]bad_network_preference|break_app_sms_permission|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop56$0.016Transcript →
[mms_issue]bad_network_preference|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop68$0.018Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop60$0.016Transcript →
[mms_issue]bad_network_preference|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop50$0.014Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_both_permissions|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:None]0passuser_stop102$0.031Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|break_app_sms_permission|data_usage_exceeded[PERSONA:Hard]0passuser_stop89$0.024Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|data_mode_off|data_usage_exceeded|unseat_sim_card[PERSONA:None]0passuser_stop78$0.022Transcript →
[mms_issue]bad_wifi_calling|break_apn_mms_setting|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop70$0.020Transcript →
[mms_issue]bad_wifi_calling|data_mode_off|data_usage_exceeded[PERSONA:Easy]0passuser_stop80$0.023Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop61$0.017Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop52$0.014Transcript →
[mms_issue]break_apn_mms_setting|user_abroad_roaming_enabled_off[PERSONA:Hard]0passuser_stop46$0.013Transcript →
[mms_issue]break_app_both_permissions|data_usage_exceeded[PERSONA:Hard]0passuser_stop55$0.018Transcript →
[mms_issue]break_app_both_permissions|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop71$0.021Transcript →
[mms_issue]break_app_sms_permission|data_mode_off[PERSONA:None]0passuser_stop62$0.017Transcript →
[mms_issue]break_app_sms_permission|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop62$0.020Transcript →
[mms_issue]break_app_storage_permission|data_usage_exceeded[PERSONA:Easy]0passuser_stop70$0.021Transcript →
[mms_issue]break_app_storage_permission|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0passuser_stop72$0.024Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference[PERSONA:Hard]0passuser_stop38$0.012Transcript →
Page 1 of 3Next →