If you need any help, feel free to ask. But all you really need to do is simply be there for students or other faculty members. Just listen to what they have to say. If they ask for advice, then just make some suggestions. Since everyone is aware of the job switches, I doubt anyone is going to come to you with any sort of real crisis.