criterion performance measurements

overview

want to understand this report?

read/Float_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.820647105184994e-6 6.9396510572167486e-6 7.086947477952498e-6
Standard deviation 3.4296636933457994e-7 4.550648816111036e-7 6.045889735889545e-7

Outlying measurements have severe (0.7381165448756368%) effect on estimated standard deviation.

read/Float_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.149752492897625e-5 3.19012236112146e-5 3.2399485579444024e-5
Standard deviation 1.2024585766146562e-6 1.5115029964759424e-6 2.0593603279006166e-6

Outlying measurements have severe (0.5417108725170907%) effect on estimated standard deviation.

read/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.736237331535281e-6 6.858418084231636e-6 6.994005969309853e-6
Standard deviation 3.3197405508722747e-7 4.2274006851745393e-7 5.553755214928012e-7

Outlying measurements have severe (0.7085028650860803%) effect on estimated standard deviation.

read/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.132544764839324e-5 3.186227256266898e-5 3.2487025257944407e-5
Standard deviation 1.5417818782202422e-6 1.8792033165922593e-6 2.4574874596851435e-6

Outlying measurements have severe (0.6432875062156287%) effect on estimated standard deviation.

attoparsec-0.13.0.0:scientific/Float_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.182375676589559e-6 2.228178852829602e-6 2.2708239794867748e-6
Standard deviation 1.1591604458558906e-7 1.4221521342653706e-7 1.7859348353637008e-7

Outlying measurements have severe (0.7476438973507353%) effect on estimated standard deviation.

attoparsec-0.13.0.0:scientific/Float_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.378689666106603e-5 1.396080861838715e-5 1.412035468653692e-5
Standard deviation 4.666350530346408e-7 5.810020881380625e-7 7.159334927758471e-7

Outlying measurements have severe (0.5006283067588343%) effect on estimated standard deviation.

attoparsec-0.13.0.0:scientific/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.196857406437674e-6 2.231606845476503e-6 2.266340910396605e-6
Standard deviation 9.791557336137045e-8 1.1860997372485289e-7 1.4168166943230367e-7

Outlying measurements have severe (0.6737852267401842%) effect on estimated standard deviation.

attoparsec-0.13.0.0:scientific/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3660998216300112e-5 1.3875967014882506e-5 1.4173963644665054e-5
Standard deviation 6.534415750971835e-7 8.244963740566781e-7 1.0816796405548843e-6

Outlying measurements have severe (0.6745592634837126%) effect on estimated standard deviation.

text-1.2.1.1:double/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.986770217230227e-7 1.015262630824218e-6 1.0331284161526847e-6
Standard deviation 4.8556378934700496e-8 5.826048367535614e-8 7.78539984808875e-8

Outlying measurements have severe (0.7224620192960411%) effect on estimated standard deviation.

text-1.2.1.1:double/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.0593380672586572e-5 1.0772529635500084e-5 1.0960551139519742e-5
Standard deviation 5.193260012914551e-7 6.280217890747711e-7 7.846985900953056e-7

Outlying measurements have severe (0.6738003975210183%) effect on estimated standard deviation.

bytestring-lexing-0.4.3.3:readDouble/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.198282808758412e-7 9.355331007590678e-7 9.528045451857683e-7
Standard deviation 4.458034248865603e-8 5.3937450129621955e-8 7.146072636563794e-8

Outlying measurements have severe (0.7250992341579373%) effect on estimated standard deviation.

bytestring-lexing-0.4.3.3:readDouble/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.609830811935936e-6 5.7061309185084595e-6 5.828544307247603e-6
Standard deviation 2.6663604412561473e-7 3.6294376883940547e-7 5.01528481633635e-7

Outlying measurements have severe (0.7266641763749729%) effect on estimated standard deviation.

bytestring-read-0.3.0:fractional/Float_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.446028101621445e-7 2.494606124776743e-7 2.560407651165737e-7
Standard deviation 1.572734866735863e-8 1.935548101063577e-8 2.5305612729553505e-8

Outlying measurements have severe (0.8462764295577727%) effect on estimated standard deviation.

bytestring-read-0.3.0:fractional/Float_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.077830043023573e-7 5.17594253801927e-7 5.282444687372933e-7
Standard deviation 2.883379820401047e-8 3.427643684570423e-8 4.12665820471081e-8

Outlying measurements have severe (0.7898654367831628%) effect on estimated standard deviation.

bytestring-read-0.3.0:fractional/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.0898061487130419e-7 2.1309970426002197e-7 2.1850960364554843e-7
Standard deviation 1.230645233360782e-8 1.5464674049105175e-8 2.148891093522466e-8

Outlying measurements have severe (0.8268702041477856%) effect on estimated standard deviation.

bytestring-read-0.3.0:fractional/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 5.200638141208734e-7 5.280122512454903e-7 5.366314001557393e-7
Standard deviation 2.2769613728562625e-8 2.811262252221249e-8 3.5358005280736944e-8

Outlying measurements have severe (0.7017311624923945%) effect on estimated standard deviation.

bytestring-read-0.3.0:fractional/Rational_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.385021148451805e-6 3.4475090896462796e-6 3.508329252551726e-6
Standard deviation 1.812723325478154e-7 2.1482933511425812e-7 2.748033784873576e-7

Outlying measurements have severe (0.7300268199973405%) effect on estimated standard deviation.

bytestring-read-0.3.0:fractional/Rational_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7966892822469548e-5 1.8199189772050033e-5 1.85565105840775e-5
Standard deviation 7.397181627253659e-7 9.671016531996715e-7 1.5871744246745101e-6

Outlying measurements have severe (0.6170581125836918%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExponential/Float_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.2763876046699882e-7 2.310762872619509e-7 2.3540096229323905e-7
Standard deviation 9.863653889602507e-9 1.2431564644031344e-8 1.5747069155767414e-8

Outlying measurements have severe (0.7223568386893122%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExponential/Float_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6842426233186566e-6 1.7148246278081475e-6 1.7613985419811988e-6
Standard deviation 9.306382266113032e-8 1.2290272358850388e-7 1.616888551158784e-7

Outlying measurements have severe (0.7951440565974819%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExponential/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.3384867602515456e-7 2.3924984571259346e-7 2.4816932323184463e-7
Standard deviation 1.515693722688555e-8 2.1733469553321263e-8 3.543924896637246e-8

Outlying measurements have severe (0.8817718001164951%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExponential/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.6855868444128677e-6 1.7188559971862796e-6 1.7573902546258346e-6
Standard deviation 9.423770194830725e-8 1.150629945729456e-7 1.690522975171797e-7

Outlying measurements have severe (0.7693931389868913%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExponential/Rational_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.6724582439918464e-6 2.7164437175714402e-6 2.772117807256612e-6
Standard deviation 1.3400554589103375e-7 1.636899274322019e-7 2.2443832325116639e-7

Outlying measurements have severe (0.7208801652459308%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExponential/Rational_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 9.082181154697546e-6 9.274106799434847e-6 9.524402286988946e-6
Standard deviation 5.506638523301747e-7 7.425370492719934e-7 1.115860621970054e-6

Outlying measurements have severe (0.8035418493806291%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@infinity/Float_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.406463584252812e-7 4.468489843763982e-7 4.549280017082057e-7
Standard deviation 1.893996509561847e-8 2.382793315754417e-8 3.2226735043939734e-8

Outlying measurements have severe (0.7068286610383039%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@infinity/Float_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.0933586426597525e-6 2.1104037921859194e-6 2.1280630886963915e-6
Standard deviation 4.71843680257522e-8 5.7708146326365815e-8 7.089000097663109e-8

Outlying measurements have moderate (0.34825465109452763%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@infinity/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.488470271069589e-7 4.5641248494407005e-7 4.655579048933216e-7
Standard deviation 2.4063077194852207e-8 2.9744911114132446e-8 3.835856145739833e-8

Outlying measurements have severe (0.7827614723670159%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@infinity/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.1354267517116064e-6 2.1824051115981146e-6 2.2525233350849477e-6
Standard deviation 1.244983477730338e-7 1.730820961268065e-7 2.4760295353690664e-7

Outlying measurements have severe (0.8219767248548713%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@infinity/Rational_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.78294256474361e-6 1.8115957963956973e-6 1.8437769854435527e-6
Standard deviation 8.156004503855173e-8 9.566548632405426e-8 1.1429972796231764e-7

Outlying measurements have severe (0.6750973525787238%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@infinity/Rational_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 6.003403278171536e-6 6.076163043576859e-6 6.209599001239305e-6
Standard deviation 2.404491755625265e-7 3.237078186931927e-7 4.722210498066698e-7

Outlying measurements have severe (0.6470991463322769%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@inherent/Float_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.722628854579832e-7 1.747215263337366e-7 1.77667575965214e-7
Standard deviation 7.323517170893599e-9 8.889801055129182e-9 1.0821500759863303e-8

Outlying measurements have severe (0.7040509032344039%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@inherent/Float_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.704797504754295e-7 3.7613835337455166e-7 3.8295157727434473e-7
Standard deviation 1.7082341430352188e-8 2.0788052549123357e-8 2.5901941671140445e-8

Outlying measurements have severe (0.7239371360795124%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@inherent/Double_short

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.7887018099671704e-7 1.8193662952529198e-7 1.8663060457073587e-7
Standard deviation 8.208699844342755e-9 1.1873641243040033e-8 2.0438799500893583e-8

Outlying measurements have severe (0.7991843594421862%) effect on estimated standard deviation.

bytestring-lexing-0.5.0:readExpLim@inherent/Double_long

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.8879936283238325e-7 3.9581879111174473e-7 4.0341431106562e-7
Standard deviation 2.148926123681885e-8 2.5487513185189583e-8 3.110549695881001e-8

Outlying measurements have severe (0.7810450607331475%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.