Benchmark Configuration

Short Description/NameScalaTest
Long DescriptionA free, open-source testing toolkit for Scala and Java programmers
AuthorBill Venners and others
LicenseApache License, Version 2.0
URLhttp://www.scalatest.org/
Version1.3

This benchmark is externally multi‐threaded, using a number of threads scaled to the number of available CPUs.

Input size small

Uses 1 thread(s) per CPU to drive the workload.

Arguments
org.scalatest.AmpersandWordSpec
org.scalatest.AssertionsSpec
org.scalatest.BeforeAndAfterExtendingFunSuite
org.scalatest.BeforeAndAfterExtendingSuite
org.scalatest.BeforeAndAfterFunctionsExtendingFunSuite
org.scalatest.BeforeAndAfterFunctionsExtendingSuite
org.scalatest.BeforeAndAfterFunctionsSuite
org.scalatest.BeforeAndAfterSuite
org.scalatest.CatchReporterSuite
org.scalatest.ClueSpec
org.scalatest.ConcurrentInformerSpec
org.scalatest.ExamplesSuite
org.scalatest.FailureMessagesSuite
org.scalatest.FeatureSpecSpec
org.scalatest.FilterSpec
org.scalatest.FlatSpecSpec
org.scalatest.FunSuiteSpec
org.scalatest.FunSuiteSuite
org.scalatest.GivenWhenThenSpec
org.scalatest.LoginUiWordSpec
org.scalatest.OneInstancePerTestSpec
org.scalatest.PrivateMethodTesterSpec
org.scalatest.SeveredStackTracesFailureSpec
org.scalatest.SeveredStackTracesSpec
org.scalatest.SpecSpec
org.scalatest.SpecSuite
org.scalatest.SuiteSpec
org.scalatest.SuiteSuite
org.scalatest.TestFailedExceptionSpec
org.scalatest.TestFailedExceptionWithImportSpec

The following is the list of outputs validated by the benchmark harness.

FilenameText file?SizeLinesDigest
stdout.logYesn/a662n/a

Input size default

Uses 1 thread(s) per CPU to drive the workload.

Arguments
org.scalatest.AmpersandWordSpec
org.scalatest.AssertionsSpec
org.scalatest.BeforeAndAfterExtendingFunSuite
org.scalatest.BeforeAndAfterExtendingSuite
org.scalatest.BeforeAndAfterFunctionsExtendingFunSuite
org.scalatest.BeforeAndAfterFunctionsExtendingSuite
org.scalatest.BeforeAndAfterFunctionsSuite
org.scalatest.BeforeAndAfterSuite
org.scalatest.CatchReporterSuite
org.scalatest.ClueSpec
org.scalatest.ConcurrentInformerSpec
org.scalatest.ExamplesSuite
org.scalatest.FailureMessagesSuite
org.scalatest.FeatureSpecSpec
org.scalatest.FilterSpec
org.scalatest.FlatSpecSpec
org.scalatest.FunSuiteSpec
org.scalatest.FunSuiteSuite
org.scalatest.GivenWhenThenSpec
org.scalatest.LoginUiWordSpec
org.scalatest.OneInstancePerTestSpec
org.scalatest.PrivateMethodTesterSpec
org.scalatest.SeveredStackTracesFailureSpec
org.scalatest.SeveredStackTracesSpec
org.scalatest.SpecSpec
org.scalatest.SpecSuite
org.scalatest.SuiteSpec
org.scalatest.SuiteSuite
org.scalatest.TestFailedExceptionSpec
org.scalatest.TestFailedExceptionWithImportSpec
org.scalatest.WordSpecSpec
org.scalatest.fixture.ConfigMapFixtureSpec
org.scalatest.fixture.FixtureFeatureSpecSpec
org.scalatest.fixture.FixtureFlatSpecSpec
org.scalatest.fixture.FixtureFunSuiteSpec
org.scalatest.fixture.FixtureSpecSpec
org.scalatest.fixture.FixtureSuiteSpec
org.scalatest.fixture.FixtureWordSpecSpec
org.scalatest.prop.CheckersSuite
org.scalatest.tools.DiscoverySuiteSuite
org.scalatest.tools.PrintReporterSuite
org.scalatest.tools.RunnerSuite
org.scalatest.tools.ScalaTestFrameworkSuite
org.scalatest.tools.ScalaTestRunnerSuite
org.scalatest.tools.SuiteDiscoveryHelperSuite
org.scalatest.tools.XmlReporterSuite

The following is the list of outputs validated by the benchmark harness.

FilenameText file?SizeLinesDigest
stdout.logYesn/a1104n/a

Input size large

Uses 1 thread(s) per CPU to drive the workload.

Arguments
org.scalatest.AmpersandWordSpec
org.scalatest.AssertionsSpec
org.scalatest.BeforeAndAfterExtendingFunSuite
org.scalatest.BeforeAndAfterExtendingSuite
org.scalatest.BeforeAndAfterFunctionsExtendingFunSuite
org.scalatest.BeforeAndAfterFunctionsExtendingSuite
org.scalatest.BeforeAndAfterFunctionsSuite
org.scalatest.BeforeAndAfterSuite
org.scalatest.CatchReporterSuite
org.scalatest.ClueSpec
org.scalatest.ConcurrentInformerSpec
org.scalatest.ExamplesSuite
org.scalatest.FailureMessagesSuite
org.scalatest.FeatureSpecSpec
org.scalatest.FilterSpec
org.scalatest.FlatSpecSpec
org.scalatest.FunSuiteSpec
org.scalatest.FunSuiteSuite
org.scalatest.GivenWhenThenSpec
org.scalatest.LoginUiWordSpec
org.scalatest.OneInstancePerTestSpec
org.scalatest.PrivateMethodTesterSpec
org.scalatest.SeveredStackTracesFailureSpec
org.scalatest.SeveredStackTracesSpec
org.scalatest.SpecSpec
org.scalatest.SpecSuite
org.scalatest.SuiteSpec
org.scalatest.SuiteSuite
org.scalatest.TestFailedExceptionSpec
org.scalatest.TestFailedExceptionWithImportSpec
org.scalatest.WordSpecSpec
org.scalatest.WordSpecSpec
org.scalatest.fixture.ConfigMapFixtureSpec
org.scalatest.fixture.FixtureFeatureSpecSpec
org.scalatest.fixture.FixtureFlatSpecSpec
org.scalatest.fixture.FixtureFunSuiteSpec
org.scalatest.fixture.FixtureSpecSpec
org.scalatest.fixture.FixtureSuiteSpec
org.scalatest.fixture.FixtureWordSpecSpec
org.scalatest.matchers.CustomMatcherSpec
org.scalatest.matchers.PropertyFunSuite
org.scalatest.matchers.ShouldBeASymbolSpec
org.scalatest.matchers.CustomMatcherSpec
org.scalatest.matchers.MustBeASymbolSpec
org.scalatest.matchers.MustBeAnSymbolSpec
org.scalatest.matchers.MustBeMatcherSpec
org.scalatest.matchers.MustBeNullSpec
org.scalatest.matchers.MustBePropertyMatcherSpec
org.scalatest.matchers.MustBeSymbolSpec
org.scalatest.matchers.MustBehaveLikeSpec
org.scalatest.matchers.MustContainElementSpec
org.scalatest.matchers.MustContainKeySpec
org.scalatest.matchers.MustContainValueSpec
org.scalatest.matchers.MustEndWithRegexSpec
org.scalatest.matchers.MustEndWithSubstringSpec
org.scalatest.matchers.MustEqualSpec
org.scalatest.matchers.MustFullyMatchSpec
org.scalatest.matchers.MustHavePropertiesSpec
org.scalatest.matchers.MustIncludeRegexSpec
org.scalatest.matchers.MustIncludeSubstringSpec
org.scalatest.matchers.MustLengthSpec
org.scalatest.matchers.MustLogicalMatcherExprSpec
org.scalatest.matchers.MustMatcherSpec
org.scalatest.matchers.MustOrderedSpec
org.scalatest.matchers.MustPlusOrMinusSpec
org.scalatest.matchers.MustSameInstanceAsSpec
org.scalatest.matchers.MustSizeSpec
org.scalatest.matchers.MustStartWithRegexSpec
org.scalatest.matchers.MustStartWithSubstringSpec
org.scalatest.matchers.PropertyFunSuite
org.scalatest.matchers.ShouldBeASymbolSpec
org.scalatest.matchers.ShouldBeAnSymbolSpec
org.scalatest.matchers.ShouldBeAnySpec
org.scalatest.matchers.ShouldBeMatcherSpec
org.scalatest.matchers.ShouldBeNullSpec
org.scalatest.matchers.ShouldBePropertyMatcherSpec
org.scalatest.matchers.ShouldBeSymbolSpec
org.scalatest.matchers.ShouldBeTripleEqualsSpec
org.scalatest.matchers.ShouldBehaveLikeSpec
org.scalatest.matchers.ShouldContainElementSpec
org.scalatest.matchers.ShouldContainKeySpec
org.scalatest.matchers.ShouldContainValueSpec
org.scalatest.matchers.ShouldEndWithRegexSpec
org.scalatest.matchers.ShouldEndWithSubstringSpec
org.scalatest.matchers.ShouldEqualSpec
org.scalatest.matchers.ShouldFileBePropertyMatcherSpec
org.scalatest.matchers.ShouldFullyMatchSpec
org.scalatest.matchers.ShouldHavePropertiesSpec
org.scalatest.matchers.ShouldIncludeRegexSpec
org.scalatest.matchers.ShouldIncludeSubstringSpec
org.scalatest.matchers.ShouldLengthSpec
org.scalatest.matchers.ShouldLogicalMatcherExprSpec
org.scalatest.matchers.ShouldMatcherSpec
org.scalatest.matchers.ShouldOrderedSpec
org.scalatest.matchers.ShouldPlusOrMinusSpec
org.scalatest.matchers.ShouldSameInstanceAsSpec
org.scalatest.matchers.ShouldSizeSpec
org.scalatest.matchers.ShouldStartWithRegexSpec
org.scalatest.matchers.ShouldStartWithSubstringSpec
org.scalatest.matchers.ShouldThrowSpec
org.scalatest.prop.CheckersSuite
org.scalatest.tools.DiscoverySuiteSuite
org.scalatest.tools.PrintReporterSuite
org.scalatest.tools.RunnerSuite
org.scalatest.tools.ScalaTestFrameworkSuite
org.scalatest.tools.ScalaTestRunnerSuite
org.scalatest.tools.SuiteDiscoveryHelperSuite
org.scalatest.tools.XmlReporterSuite

The following is the list of outputs validated by the benchmark harness.

FilenameText file?SizeLinesDigest
stdout.logYesn/a4026n/a

Input size huge

Uses 1 thread(s) per CPU to drive the workload.

Arguments
org.scalatest.AmpersandWordSpec
org.scalatest.AssertionsSpec
org.scalatest.BeforeAndAfterExtendingFunSuite
org.scalatest.BeforeAndAfterExtendingSuite
org.scalatest.BeforeAndAfterFunctionsExtendingFunSuite
org.scalatest.BeforeAndAfterFunctionsExtendingSuite
org.scalatest.BeforeAndAfterFunctionsSuite
org.scalatest.BeforeAndAfterSuite
org.scalatest.CatchReporterSuite
org.scalatest.ClueSpec
org.scalatest.ConcurrentInformerSpec
org.scalatest.ExamplesSuite
org.scalatest.FailureMessagesSuite
org.scalatest.FeatureSpecSpec
org.scalatest.FilterSpec
org.scalatest.FlatSpecSpec
org.scalatest.FunSuiteSpec
org.scalatest.FunSuiteSuite
org.scalatest.GivenWhenThenSpec
org.scalatest.LoginUiWordSpec
org.scalatest.OneInstancePerTestSpec
org.scalatest.PrivateMethodTesterSpec
org.scalatest.SeveredStackTracesFailureSpec
org.scalatest.SeveredStackTracesSpec
org.scalatest.SpecSpec
org.scalatest.SpecSuite
org.scalatest.SuiteSpec
org.scalatest.SuiteSuite
org.scalatest.TestFailedExceptionSpec
org.scalatest.TestFailedExceptionWithImportSpec
org.scalatest.WordSpecSpec
org.scalatest.WordSpecSpec
org.scalatest.events.EventSpec
org.scalatest.events.OrdinalSpec
org.scalatest.fixture.ConfigMapFixtureSpec
org.scalatest.fixture.FixtureFeatureSpecSpec
org.scalatest.fixture.FixtureFlatSpecSpec
org.scalatest.fixture.FixtureFunSuiteSpec
org.scalatest.fixture.FixtureSpecSpec
org.scalatest.fixture.FixtureSuiteSpec
org.scalatest.fixture.FixtureWordSpecSpec
org.scalatest.matchers.CustomMatcherSpec
org.scalatest.matchers.PropertyFunSuite
org.scalatest.matchers.ShouldBeASymbolSpec
org.scalatest.matchers.CustomMatcherSpec
org.scalatest.matchers.MustBeASymbolSpec
org.scalatest.matchers.MustBeAnSymbolSpec
org.scalatest.matchers.MustBeMatcherSpec
org.scalatest.matchers.MustBeNullSpec
org.scalatest.matchers.MustBePropertyMatcherSpec
org.scalatest.matchers.MustBeSymbolSpec
org.scalatest.matchers.MustBehaveLikeSpec
org.scalatest.matchers.MustContainElementSpec
org.scalatest.matchers.MustContainKeySpec
org.scalatest.matchers.MustContainValueSpec
org.scalatest.matchers.MustEndWithRegexSpec
org.scalatest.matchers.MustEndWithSubstringSpec
org.scalatest.matchers.MustEqualSpec
org.scalatest.matchers.MustFullyMatchSpec
org.scalatest.matchers.MustHavePropertiesSpec
org.scalatest.matchers.MustIncludeRegexSpec
org.scalatest.matchers.MustIncludeSubstringSpec
org.scalatest.matchers.MustLengthSpec
org.scalatest.matchers.MustLogicalMatcherExprSpec
org.scalatest.matchers.MustMatcherSpec
org.scalatest.matchers.MustOrderedSpec
org.scalatest.matchers.MustPlusOrMinusSpec
org.scalatest.matchers.MustSameInstanceAsSpec
org.scalatest.matchers.MustSizeSpec
org.scalatest.matchers.MustStartWithRegexSpec
org.scalatest.matchers.MustStartWithSubstringSpec
org.scalatest.matchers.PropertyFunSuite
org.scalatest.matchers.ShouldBeASymbolSpec
org.scalatest.matchers.ShouldBeAnSymbolSpec
org.scalatest.matchers.ShouldBeAnySpec
org.scalatest.matchers.ShouldBeMatcherSpec
org.scalatest.matchers.ShouldBeNullSpec
org.scalatest.matchers.ShouldBePropertyMatcherSpec
org.scalatest.matchers.ShouldBeSymbolSpec
org.scalatest.matchers.ShouldBeTripleEqualsSpec
org.scalatest.matchers.ShouldBehaveLikeSpec
org.scalatest.matchers.ShouldContainElementSpec
org.scalatest.matchers.ShouldContainKeySpec
org.scalatest.matchers.ShouldContainValueSpec
org.scalatest.matchers.ShouldEndWithRegexSpec
org.scalatest.matchers.ShouldEndWithSubstringSpec
org.scalatest.matchers.ShouldEqualSpec
org.scalatest.matchers.ShouldFileBePropertyMatcherSpec
org.scalatest.matchers.ShouldFullyMatchSpec
org.scalatest.matchers.ShouldHavePropertiesSpec
org.scalatest.matchers.ShouldIncludeRegexSpec
org.scalatest.matchers.ShouldIncludeSubstringSpec
org.scalatest.matchers.ShouldLengthSpec
org.scalatest.matchers.ShouldLogicalMatcherExprSpec
org.scalatest.matchers.ShouldMatcherSpec
org.scalatest.matchers.ShouldOrderedSpec
org.scalatest.matchers.ShouldPlusOrMinusSpec
org.scalatest.matchers.ShouldSameInstanceAsSpec
org.scalatest.matchers.ShouldSizeSpec
org.scalatest.matchers.ShouldStartWithRegexSpec
org.scalatest.matchers.ShouldStartWithSubstringSpec
org.scalatest.matchers.ShouldThrowSpec
org.scalatest.prop.CheckersSuite
org.scalatest.tools.DiscoverySuiteSuite
org.scalatest.tools.PrintReporterSuite
org.scalatest.tools.RunnerSuite
org.scalatest.tools.ScalaTestFrameworkSuite
org.scalatest.tools.ScalaTestRunnerSuite
org.scalatest.tools.SuiteDiscoveryHelperSuite
org.scalatest.tools.XmlReporterSuite

The following is the list of outputs validated by the benchmark harness.

FilenameText file?SizeLinesDigest
stdout.logYesn/a4037n/a