Simeval#

Pharmpy currently creates results after a PsN simeval run.

The simeval results#

Sampled Individual OFVs#

The sampled_iofv table contains the evaluated individual OFVs for each sampled dataset.

1 2 3 4 5 6 7 8 9 10
ID
1 10.488686 10.230120 6.853273 9.215148 8.921633 7.885525 7.860736 15.995045 7.575351 7.165042
2 10.824880 8.027733 12.533799 7.993262 10.946876 12.080061 12.568383 9.482883 9.300884 8.083424
3 13.916884 12.654589 17.322738 10.905658 19.604188 17.276361 15.376218 11.005653 26.928279 13.180960
4 12.638247 8.370783 13.546277 10.313336 9.467337 16.489785 7.898802 10.098483 12.795252 12.364078
5 12.136159 10.957716 14.058260 14.542369 9.472019 9.968860 11.773450 9.706108 13.078494 15.351839
6 10.151210 12.664634 9.775938 11.873918 9.318875 9.210594 17.600450 10.916754 11.823449 10.221459
7 11.551158 16.527835 8.793703 18.899285 9.526828 8.639544 12.104682 10.136767 7.405150 10.135159
8 20.796073 10.615899 10.330868 10.230477 13.293600 13.185132 11.354616 11.488282 16.406903 9.562788
9 16.486179 14.818812 14.438225 12.479966 15.376893 12.720261 18.884839 14.736463 18.892761 13.328937
10 14.121901 17.446579 9.924846 18.432346 11.114640 12.436720 9.367480 19.061750 11.849137 11.929665
11 5.512627 5.615092 11.024193 10.694969 5.408347 7.341680 5.054791 5.925921 5.423537 5.247238
12 10.842566 17.018308 16.548598 13.387386 10.867625 12.759167 13.864669 13.962122 12.705806 16.484284
13 11.638560 9.664954 6.424024 11.853355 7.078385 7.317393 10.280139 8.086333 8.056381 10.114753
14 20.622712 16.282087 13.413680 17.695800 15.882876 15.331177 14.631655 13.603301 10.449888 11.178961
15 7.361556 9.678095 7.704503 12.541680 9.037941 7.371773 9.758919 14.748996 8.138213 7.238692
16 21.422555 10.166879 10.026935 15.316351 12.708577 10.966413 9.814952 11.272954 10.929655 13.713778
17 11.266944 11.567697 10.009725 17.937635 12.989005 12.878300 9.715708 9.421235 9.563473 15.335429
18 13.212573 17.388393 22.459161 12.462408 14.621329 18.868224 14.383043 14.480043 24.959843 14.461262
19 11.003027 17.277388 12.260472 10.179394 12.110075 11.933191 13.676905 8.300601 10.811596 15.501489
20 11.380865 14.366018 10.398492 23.218010 21.905147 11.585174 9.956306 11.570879 8.786560 9.219194
21 13.546036 12.961895 18.191401 14.051986 22.534496 17.726349 18.445912 19.351180 14.612812 19.630512
22 8.682987 10.231970 8.553003 12.767349 8.900845 7.099846 8.876780 6.806204 8.584818 10.816485
23 20.802797 17.988276 15.846457 20.822404 17.749003 15.991350 15.924166 14.998400 16.892200 20.776532
24 20.662582 18.725509 21.207434 20.565671 21.196823 18.326447 21.115117 23.225727 19.018880 27.015416
25 13.488859 17.212538 28.434087 29.341361 14.851698 19.782192 17.806515 26.348921 15.250063 29.838099
26 16.743671 13.140249 11.599116 13.086788 15.429352 15.574493 13.296737 15.382526 12.944073 13.297823
27 7.880881 11.659430 7.831345 9.516464 12.191840 7.994987 10.574667 9.857266 11.485191 9.409142
28 8.630846 5.775355 5.901408 5.793265 5.956378 9.072216 8.874349 6.002572 6.733704 5.755737
29 8.483346 3.794788 3.693935 3.912201 3.668763 3.711150 3.676572 4.151243 3.707700 3.851982
30 13.793645 11.382384 8.905528 12.069326 8.455902 9.800871 9.954047 11.931900 9.538437 8.401748
31 4.928532 4.498709 6.186642 6.077897 6.425364 4.748099 4.731336 4.376121 5.196475 9.926835
32 15.366585 20.497867 16.773375 19.819544 17.030662 22.247095 23.504667 17.372391 18.848184 15.985533
33 9.551208 11.565811 8.762211 9.843029 8.662370 7.765259 12.455400 8.826862 10.572217 12.551558
34 10.552114 10.630121 11.056323 9.187278 8.580405 8.257409 10.502366 8.119652 8.298009 8.042324
35 12.040276 11.035731 10.370226 11.802175 9.275622 10.360000 14.305631 12.134650 9.361844 11.406685
36 15.515088 12.957232 10.597045 12.639042 14.155311 10.716192 10.544260 13.266702 12.169391 11.496993
37 7.751915 8.361498 9.400720 10.977219 7.363698 8.676934 9.022410 8.868679 16.106708 18.454421
38 20.952586 14.024682 13.974785 25.641421 15.434510 20.597599 15.424237 15.982047 21.904024 14.889492
39 14.073683 13.575363 16.886356 13.853009 18.073635 15.087082 18.098997 14.169297 15.840067 16.835458
40 7.879430 7.253049 5.712658 19.374133 8.169888 7.151935 6.963905 8.856403 7.884553 9.819836
41 10.178975 12.497236 17.044583 13.415675 12.564632 11.567520 17.351619 12.118999 12.893425 18.285544
42 15.264764 11.765897 14.360173 12.396594 9.695028 9.999275 11.255630 9.509070 12.046265 10.277992
43 4.572606 4.586789 4.414926 4.358567 3.516160 3.899880 3.408061 3.324755 3.684344 3.688954
44 12.244786 12.249772 13.907778 20.496109 13.916145 19.473731 11.297200 12.394438 13.493584 11.841335
45 9.416676 16.659481 8.362886 6.222423 7.744242 11.864820 12.606428 15.119216 6.933397 6.253768
46 4.069317 4.936980 4.988252 5.206488 5.269584 3.862927 5.693535 4.448507 5.178177 3.731451
47 8.716822 5.605768 6.517867 5.911020 5.737404 6.965455 5.764024 6.518105 6.477206 5.746436
48 18.125029 11.980420 21.346212 29.453899 11.132983 12.500103 10.133073 10.320820 21.408266 15.763155
49 9.583418 26.811144 16.462547 19.783555 24.105503 12.585654 12.027851 11.180204 19.337790 13.686115
50 16.363551 12.031564 23.036534 18.972480 19.850645 16.960296 24.402983 23.457112 20.195385 19.043157
51 7.892175 11.525306 10.378125 9.723710 9.052073 8.587323 16.032512 15.814145 8.016286 10.225458
52 12.242420 11.404922 10.269137 8.408322 10.435102 9.950516 7.788249 10.602344 8.846592 12.699366
53 11.512603 13.815026 9.448461 11.159667 7.589215 7.884049 8.777419 10.451814 8.243399 7.509957
54 20.175264 14.926077 21.541949 23.625663 17.923185 16.601504 28.416254 14.866250 15.933824 18.481351
55 9.194473 5.944302 4.371639 4.907322 4.824234 4.487277 4.418469 4.495039 5.087071 4.422555
56 2.550825 2.735586 2.663661 2.606033 2.903583 2.547459 2.675347 2.573838 2.611250 6.344235
57 10.875052 8.556035 14.500411 9.584165 10.501681 10.247584 13.271405 10.749030 14.860290 9.308617
58 9.432371 14.874004 19.881148 12.824837 13.372005 15.804622 13.876965 12.941132 18.153441 12.631308
59 15.323449 16.133006 10.366355 11.348849 16.357159 9.319025 9.885439 17.193338 12.054769 10.758791

Individual OFV summary#

The iofv_summary table contain the iOFVs from the orginal model, the mean and standard deviation of the sampled iOFVs, the residual and a residual outlier flag. The residual for each sample and ID is the distance from the observed iOFV to the simulated iOFV expressed in standard deviations of the simulated values.

\[\mathrm{res} = \frac{\mathrm{obs} - \operatorname{mean}(\mathrm{sim})}{\operatorname{sd}(\mathrm{sim})}\]

An individual is defined as an outlier if the corresponding residual is 3 or higher.

original sampled_mean sampled_stdev residual residual_q1 residual_q3 residual_outlier
ID
1 7.743042 9.219056 2.682820 -0.550173 0.035912 -0.832458 False
2 12.049484 10.184218 1.853744 1.006216 1.975298 0.136329 False
3 12.041599 15.817153 4.833045 -0.781196 -0.154061 -1.090316 False
4 12.813525 11.398238 2.645044 0.535071 1.205425 0.021748 False
5 10.092618 12.104527 2.106160 -0.955250 -0.058617 -1.766581 False
6 14.344659 11.355728 2.480441 1.205000 1.804075 1.001176 False
7 11.093249 11.372011 3.653334 -0.076303 0.579270 -0.238974 False
8 13.515891 12.726464 3.480796 0.226795 0.894556 0.071653 False
9 15.321253 15.216333 2.282456 0.045968 0.751381 -0.388881 False
10 10.998817 13.568506 3.544129 -0.725055 -0.084491 -1.584759 False
11 5.216676 6.724839 2.269729 -0.664468 -0.086120 -0.780298 False
12 12.099508 13.844053 2.234199 -0.780837 -0.277342 -1.680349 False
13 10.322169 9.051428 1.923117 0.660772 1.466385 0.043355 False
14 18.260479 14.909214 3.004430 1.115441 1.597439 0.691710 False
15 7.671231 9.358037 2.499079 -0.674971 0.086542 -0.827298 False
16 12.331370 12.633905 3.558617 -0.085015 0.554653 -0.317850 False
17 12.936751 12.068515 2.800265 0.310055 1.124015 -0.008777 False
18 19.712276 16.729628 4.167439 0.715703 1.274087 0.291308 False
19 12.019852 12.305414 2.613668 -0.109257 0.443973 -0.498512 False
20 12.056317 13.238664 5.161298 -0.229080 0.385458 -0.312807 False
21 12.248420 17.105258 3.155784 -1.539027 -0.615940 -2.178997 False
22 7.605320 9.132029 1.756164 -0.869343 -0.544161 -1.306182 False
23 19.814910 17.779158 2.268737 0.897306 1.707535 -0.116610 False
24 27.453306 21.105961 2.531367 2.507478 3.179203 2.468439 False
25 27.964192 21.235433 6.534690 1.029698 1.870557 0.007865 False
26 13.187065 14.049483 1.611648 -0.535116 0.053927 -1.384037 False
27 9.077425 9.840121 1.621227 -0.470444 0.449597 -1.344744 False
28 7.941064 6.849583 1.418397 0.769517 1.495183 -0.151930 False
29 5.074840 4.265168 1.489546 0.543569 0.924754 0.790639 False
30 9.255799 10.423379 1.792450 -0.651388 0.107140 -1.416342 False
31 5.103779 5.709601 1.655290 -0.365991 0.222470 -0.637759 False
32 19.908651 18.744590 2.726324 0.426971 1.126409 -0.153920 False
33 7.743926 10.055593 1.673502 -1.381335 -0.618133 -2.135334 False
34 8.047349 9.322600 1.222872 -1.042834 -0.180077 -2.038095 False
35 9.430602 11.209284 1.495631 -1.189252 -0.623118 -1.705065 False
36 13.780755 12.405726 1.643222 0.836788 1.746180 0.359915 False
37 8.378962 10.498420 3.745719 -0.565835 -0.016391 -0.588440 False
38 16.193803 17.882538 4.054206 -0.416539 0.288743 -1.151899 False
39 15.598975 15.649295 1.743847 -0.028856 0.860963 -0.730945 False
40 6.709391 8.906579 3.841825 -0.571912 -0.121771 -0.514178 False
41 11.219260 13.791821 2.756310 -0.933335 -0.360735 -1.784304 False
42 18.121911 11.657069 1.952413 3.311206 4.124618 2.977290 True
43 6.229621 3.945504 0.493299 4.630288 5.415407 3.707253 True
44 10.756085 14.131488 3.213636 -1.050337 -0.463633 -0.982678 False
45 10.980475 10.118333 3.749123 0.229958 1.025404 -0.384237 False
46 4.813878 4.738522 0.668408 0.112740 0.972107 -0.576792 False
47 6.235064 6.396011 0.934618 -0.172206 0.518106 -0.302778 False
48 35.392308 16.216396 6.339562 3.024801 3.793238 2.342653 True
49 12.057118 16.556378 5.796045 -0.776264 -0.019010 -1.313826 False
50 19.430617 19.431370 3.731493 -0.000202 0.527208 -0.775998 False
51 15.010968 10.724711 2.959211 1.448445 2.131466 1.274818 False
52 16.302385 10.264697 1.597597 3.779232 4.494133 3.191111 True
53 9.292477 9.639161 2.067293 -0.167700 0.637834 -0.817604 False
54 15.067793 19.249132 4.314731 -0.969084 -0.239401 -1.421290 False
55 4.359860 5.215238 1.477740 -0.578842 -0.053376 -0.461701 False
56 7.340902 3.021182 1.172446 3.684367 4.059050 3.940801 True
57 9.515114 11.245427 2.197044 -0.787564 -0.106919 -1.437023 False
58 11.970391 14.379183 2.982728 -0.807580 -0.296212 -1.207477 False
59 13.639192 12.874018 3.032032 0.252364 1.047063 -0.755739 False

Individual prediction plot#

The individual_predictions_plot show PRED, IPRED and DV vs TIME (if available) for outlying individuals.