The OWLReasoner Benchmark Framework is intended as a tool for OWL DL reasoner performance evaluation; in its current incarnation, it consists of OWL API code to perform a set of tasks on an OWL 2 DL ontology, such as entailment checking, instance checking, and subclasses/superclasses/properties queries.
A simple format is used to record the performance of the reasoner being evaluated, basically consisting of number of calls and elapsed time for each of the OWLReasoner interface methods. Such results will be available on this website, and we encourage reasoner developers and interested users to run the tests and submit their own results and/or settings and optimization tricks; we also encourage submission of new tests, such as new ontologies or new query patterns.