Aircraft never has the same stability/control at high alt as it has at low alt. So we shouldn't expect it from the model.
But of course we do our best to provide our model performance as close to real F104 as possible.