Linearize simulink model with many table lookup and interpolations get NaN and Inf values as output

Hi. I am trying to linearize a simulink a simulink model using linmod2 and i often get NaN or Inf values in A and B output matrix. There are a lot of lookup tables and interpolations in the model. Is there a way to get the linearization working?

I tried changing the perturbation level, when it is set to a high value the linearization works but is completely inaccurate. When it is too small it get Inf or NaN values.