Can you just go to the employment office?

Yes, but better with an appointment.

Short-notice visits often only with waiting time.

Many matters can be handled online.