ZAZUMODELSBLOG

Model library · Qwen3.5-9B · 2026-10-17

Telecom simulations

Tests reasoning through a phone diagnostic.

Allpassfailerror
444 simulations
TaskTrialResultEndedMessagesCost
[mms_issue]bad_wifi_calling|break_apn_mms_setting|unseat_sim_card|user_abroad_roaming_enabled_off[PERSONA:Easy]3passuser_stop60$0.049Transcript →
[mms_issue]bad_wifi_calling|data_mode_off|data_usage_exceeded[PERSONA:Easy]0passuser_stop54$0.050Transcript →
[mms_issue]bad_wifi_calling|data_mode_off|data_usage_exceeded[PERSONA:Easy]2passuser_stop70$0.071Transcript →
[mms_issue]bad_wifi_calling|data_mode_off|data_usage_exceeded[PERSONA:Easy]3passuser_stop70$0.063Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop66$0.059Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:Hard]1passuser_stop78$0.070Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:Hard]2passuser_stop76$0.091Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:Hard]3passuser_stop78$0.086Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop44$0.038Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:Hard]1passuser_stop46$0.039Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:Hard]2passuser_stop46$0.050Transcript →
[mms_issue]break_apn_mms_setting|data_mode_off|user_abroad_roaming_disabled_on[PERSONA:Hard]3passuser_stop42$0.038Transcript →
[mms_issue]break_apn_mms_setting|user_abroad_roaming_enabled_off[PERSONA:Hard]0passuser_stop58$0.058Transcript →
[mms_issue]break_apn_mms_setting|user_abroad_roaming_enabled_off[PERSONA:Hard]1passuser_stop42$0.043Transcript →
[mms_issue]break_apn_mms_setting|user_abroad_roaming_enabled_off[PERSONA:Hard]2passuser_stop44$0.048Transcript →
[mms_issue]break_apn_mms_setting|user_abroad_roaming_enabled_off[PERSONA:Hard]3passuser_stop44$0.047Transcript →
[mms_issue]break_app_both_permissions|data_usage_exceeded[PERSONA:Hard]0passuser_stop72$0.077Transcript →
[mms_issue]break_app_both_permissions|data_usage_exceeded[PERSONA:Hard]1passuser_stop70$0.055Transcript →
[mms_issue]break_app_both_permissions|data_usage_exceeded[PERSONA:Hard]2passuser_stop58$0.051Transcript →
[mms_issue]break_app_both_permissions|data_usage_exceeded[PERSONA:Hard]3passuser_stop58$0.056Transcript →
[mms_issue]break_app_both_permissions|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]0passuser_stop54$0.057Transcript →
[mms_issue]break_app_both_permissions|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]1passuser_stop56$0.053Transcript →
[mms_issue]break_app_both_permissions|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]2passuser_stop54$0.058Transcript →
[mms_issue]break_app_both_permissions|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Hard]3passuser_stop54$0.055Transcript →
[mms_issue]break_app_sms_permission|data_mode_off[PERSONA:None]0passuser_stop50$0.049Transcript →
[mms_issue]break_app_sms_permission|data_mode_off[PERSONA:None]1passuser_stop42$0.034Transcript →
[mms_issue]break_app_sms_permission|data_mode_off[PERSONA:None]2passuser_stop46$0.039Transcript →
[mms_issue]break_app_sms_permission|data_mode_off[PERSONA:None]3passuser_stop42$0.039Transcript →
[mms_issue]break_app_sms_permission|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop62$0.049Transcript →
[mms_issue]break_app_sms_permission|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]1passuser_stop58$0.061Transcript →
[mms_issue]break_app_sms_permission|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]2passuser_stop60$0.055Transcript →
[mms_issue]break_app_sms_permission|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]3passuser_stop58$0.054Transcript →
[mms_issue]break_app_storage_permission|data_usage_exceeded[PERSONA:Easy]1passuser_stop58$0.055Transcript →
[mms_issue]break_app_storage_permission|data_usage_exceeded[PERSONA:Easy]2passuser_stop52$0.043Transcript →
[mms_issue]break_app_storage_permission|data_usage_exceeded[PERSONA:Easy]3passuser_stop92$0.092Transcript →
[mms_issue]break_app_storage_permission|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]0passuser_stop60$0.055Transcript →
[mms_issue]break_app_storage_permission|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]1passuser_stop54$0.033Transcript →
[mms_issue]break_app_storage_permission|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]2passuser_stop46$0.026Transcript →
[mms_issue]break_app_storage_permission|unseat_sim_card|user_abroad_roaming_disabled_on[PERSONA:Easy]3passuser_stop52$0.030Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference[PERSONA:Hard]0passuser_stop30$0.038Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference[PERSONA:Hard]1passuser_stop30$0.029Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference[PERSONA:Hard]2passuser_stop26$0.015Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference[PERSONA:Hard]3passuser_stop30$0.018Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|bad_vpn|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]0passuser_stop66$0.082Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|bad_vpn|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]1passuser_stop62$0.068Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|bad_vpn|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]2passuser_stop62$0.066Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|bad_vpn|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_off[PERSONA:Hard]3passuser_stop60$0.058Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|bad_vpn|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]0passuser_stop62$0.056Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|bad_vpn|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]1passuser_stop74$0.074Transcript →
[mobile_data_issue]airplane_mode_on|bad_network_preference|bad_vpn|data_mode_off|data_saver_mode_on|data_usage_exceeded|user_abroad_roaming_disabled_on[PERSONA:None]2passuser_stop50$0.047Transcript →