Transformer on a forecast problem [D]

Hello Everyone. I’m posting here to look for any ideas for my current problem. I’m trying to predict if something will be available or not in the next 4 days. As expected the normal load of that thing is during the day. My current model is just predicting the state “busy” for that period of time where there is multiple loads during the day. Right now I have 8 features for day and time(sin and cos) and the signal from the thing.

I’ve mixed the weights on the classes but couldn’t get what I wanted