ZAZUMODELSBLOG

Model library · Gemma 4 31B · 2026-11-09

Telecom simulations

Tests reasoning through a phone diagnostic.

Allpassfailerror
80 simulations
TaskTrialResultEndedMessagesCost
[mobile_data_issue]data_saver_mode_on|data_usage_exceeded[PERSONA:Easy]0passuser_stop43$0.025Transcript →
[mobile_data_issue]data_saver_mode_on|user_abroad_roaming_enabled_off[PERSONA:Easy]0passuser_stop30$0.012Transcript →
[service_issue]airplane_mode_on|break_apn_settings[PERSONA:Hard]0passuser_stop34$0.017Transcript →
[service_issue]airplane_mode_on|break_apn_settings|contract_end_suspension|lock_sim_card_pin[PERSONA:None]0passuser_stop28$0.018Transcript →
[service_issue]airplane_mode_on|break_apn_settings|contract_end_suspension|lock_sim_card_pin|unseat_sim_card[PERSONA:Easy]0passuser_stop48$0.031Transcript →
[service_issue]airplane_mode_on|break_apn_settings|contract_end_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop46$0.023Transcript →
[service_issue]airplane_mode_on|break_apn_settings|lock_sim_card_pin[PERSONA:None]0passuser_stop26$0.014Transcript →
[service_issue]airplane_mode_on|break_apn_settings|lock_sim_card_pin|overdue_bill_suspension[PERSONA:Hard]0passuser_stop40$0.026Transcript →
[service_issue]airplane_mode_on|break_apn_settings|lock_sim_card_pin|overdue_bill_suspension|unseat_sim_card[PERSONA:None]0passuser_stop54$0.033Transcript →
[service_issue]airplane_mode_on|break_apn_settings|lock_sim_card_pin|unseat_sim_card[PERSONA:None]0passuser_stop38$0.018Transcript →
[service_issue]airplane_mode_on|break_apn_settings|overdue_bill_suspension[PERSONA:None]0passuser_stop58$0.032Transcript →
[service_issue]airplane_mode_on|break_apn_settings|unseat_sim_card[PERSONA:None]0passuser_stop44$0.019Transcript →
[service_issue]airplane_mode_on|contract_end_suspension|lock_sim_card_pin|unseat_sim_card[PERSONA:Hard]0passuser_stop12$0.007Transcript →
[service_issue]airplane_mode_on|lock_sim_card_pin[PERSONA:Easy]0passuser_stop22$0.013Transcript →
[service_issue]airplane_mode_on|lock_sim_card_pin|overdue_bill_suspension[PERSONA:Easy]0passuser_stop42$0.028Transcript →
[service_issue]airplane_mode_on|lock_sim_card_pin|overdue_bill_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop50$0.029Transcript →
[service_issue]airplane_mode_on|lock_sim_card_pin|unseat_sim_card[PERSONA:Hard]0passuser_stop38$0.019Transcript →
[service_issue]airplane_mode_on|overdue_bill_suspension[PERSONA:None]0passuser_stop34$0.022Transcript →
[service_issue]airplane_mode_on|overdue_bill_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop38$0.023Transcript →
[service_issue]airplane_mode_on|unseat_sim_card[PERSONA:None]0passuser_stop26$0.015Transcript →
[service_issue]break_apn_settings|contract_end_suspension|lock_sim_card_pin[PERSONA:Hard]0passuser_stop30$0.019Transcript →
[service_issue]break_apn_settings|contract_end_suspension|lock_sim_card_pin|unseat_sim_card[PERSONA:Hard]0passuser_stop42$0.023Transcript →
[service_issue]break_apn_settings|lock_sim_card_pin[PERSONA:None]0passuser_stop22$0.012Transcript →
[service_issue]break_apn_settings|lock_sim_card_pin|overdue_bill_suspension[PERSONA:Easy]0passuser_stop17$0.009Transcript →
[service_issue]break_apn_settings|lock_sim_card_pin|overdue_bill_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop43$0.029Transcript →
[service_issue]break_apn_settings|overdue_bill_suspension|unseat_sim_card[PERSONA:Hard]0passuser_stop60$0.035Transcript →
[service_issue]contract_end_suspension|lock_sim_card_pin[PERSONA:Hard]0passuser_stop18$0.010Transcript →
[service_issue]contract_end_suspension|unseat_sim_card[PERSONA:Hard]0passuser_stop22$0.016Transcript →
[service_issue]lock_sim_card_pin|overdue_bill_suspension[PERSONA:Easy]0passuser_stop42$0.026Transcript →
[service_issue]overdue_bill_suspension|unseat_sim_card[PERSONA:Easy]0passuser_stop41$0.027Transcript →
← PreviousPage 2 of 2