                 Changes in version 1.19.1 (2026-08-27)                 

    o   Added a FAQ vignette

    o   Removed unused 'tcltk' from Suggests

    o   Tests now skip if Suggest'ed packages are missing

    o   Fix CRAN checks NOTE about 'structure()' special names ('.Names', '.Dim', '.Dimnames')

                Changes in version 1.19.0.1 (2025-07-31)                

    o   Move 'fun.sesp' definition to work around LudvigOlsen/cvms#44

                       Changes in version 1.19.0                        

    o   'ci.coords' can now take the same 'input' values as 'coords' (issue #90)

    o   'ci.coords' can be 'plot'ted

    o   Added "lr_pos" and "lr_neg" to 'coords' (issue #102)

    o   'coords' with partial.auc now interpolates bounds when needed

    o   Added 'ignore.partial.auc' argument to 'coords'

    o   Deprecated 'transpose', 'as.list', 'as.matrix' and 'drop' in 'coords'

    o   Deprecated the 'algorithm' argument to 'roc' and 'fun.sesp' value

    o   Deprecated the 'progress' and 'parallel' argument for bootstrap operations.

    o   Removed dependencies on 'doParallel' and retired package 'plyr' (thanks to Michael Chirico, pr #134, #135, #136, #137, #138, #139 and #140).

                 Changes in version 1.18.5 (2023-11-01)                 

    o   Fixed formula input when given as variable and combined with `with` (issue #111)

    o   Fixed formula containing variables with spaces (issue #120)

    o   Fixed broken grouping when `colour` argument was given in `ggroc` (issue #121)

                 Changes in version 1.18.4 (2023-07-05)                 

    o   Fix regression in 1.18.3 in 'legacy.axes' in 'ggroc'

                       Changes in version 1.18.3                        

    o   Fix warning about 'aes_string' in 'ggroc'

    o   Improvements in tests (thanks to Michael Chirico, pr #114, #115)

    o   Fix upcoming CRAN warning about numeric version comparisons

                 Changes in version 1.18.2 (2023-05-13)                 

    o   Fix CRAN submission NOTE (issue #112)

                       Changes in version 1.18.1                        

    o   Fix 'print'ing some curves built from a formula (issue #101)

    o   Fix tests following upstream updates in density() (https://bugs.r-project.org/show_bug.cgi?id=18337)

    o   Improvements in documentation

                 Changes in version 1.18.0 (2021-09-03)                 

    o   Add CI of the estimate for 'roc.test' (DeLong, paired only for now) (code contributed by Zane Billings) (pr #95) 

    o   Fix documentation and alternative hypothesis for Venkatraman test (issue #92)

                Changes in version 1.17.0.1 (2021-01-13)                

    o   Fix CRAN incoming checks as requested by CRAN

                       Changes in version 1.17.0                        

    o   Accept more values in 'input' of coords (issue #67)

    o   Accept 'kappa' for the 'power.roc.test' of two ROC curves (issue #82)

    o   The 'input' argument to 'coords' for 'smooth.roc' curves no longer has a default

    o   The 'x' argument to 'coords' for 'smooth.roc' can now be set to 'all' (also the default)

    o   Fix bootstrap roc.test and cov with 'smooth.roc' curves

    o   The 'ggroc' function can now plot 'smooth.roc' curves (issue #86)

    o   Remove warnings with 'warnPartialMatchDollar' option (issue #87)

    o   Make tests depending on vdiffr conditional (issue #88)

                 Changes in version 1.16.2 (2020-03-19)                 

    o   Skip test depending on Rcpp version

                 Changes in version 1.16.1 (2020-01-14)                 

    o   Skip timing-dependent test failing occasionally on CRAN

                 Changes in version 1.16.0 (2020-01-12)                 

    o   BACKWARD INCOMPATIBLE CHANGE: 'transpose' argument to 'coords' switched to FALSE by default (issue #54)

    o   BACKWARD INCOMPATIBLE CHANGE: 'ci.coords' return value is now of list type and easier to use

    o   Fix one-sided DeLong test for curves with 'direction=">"' (issue #64)

    o   Fix an error in 'ci.coords' due to expected NA values in some coords (like "precision") (issue #65)

    o   Ordrered predictors are converted to numeric in a more robust way (issue #63)

    o   Cleaned up 'power.roc.test' code (issue #50)

    o   Fix pairing with 'roc.formula' and warn if 'na.action' is not set to "na.pass" or "na.fail" (issue #68)

    o   Fix 'ci.coords' not working with 'smooth.roc' curves

                 Changes in version 1.15.3 (2019-07-21)                 

    o   Fix: previous version accidentally set transpose = FALSE, should only be for next major release

                       Changes in version 1.15.2                        

    o   Fix -Inf threshold in coords for curves with 'direction = ">"' (issue #60)

    o   Restore lazy loading of the data and fix an 'R CMD check' warning "Variables with usage in documentation object 'aSAH' not in code"

                       Changes in version 1.15.1                        

    o   Fix erroneous error in 'ci.coords' with 'ret="threshold"' (issue #57)

    o   Fix vdiffr unit tests with ggplot2 3.2.0 (issue #53)

    o   Keep list order in 'ggroc' (issue #58)

                 Changes in version 1.15.0 (2019-06-01)                 

    o   'roc' now prints messages when autodetecting 'levels' and 'direction' by default. Turn off with 'quiet = TRUE' or set these values explicitly

    o   Speedup with 'algorithm = 2' (issue #44) and in 'coords' (issue #52)

    o   New 'algorithm = 6' (used by default) uses 'algorithm = 2' for numeric data, and 'algorithm = 3' for ordered vectors

    o   New 'roc.data.frame' method and 'roc_' function for use in pipelines

    o   'coords' can now returns 'youden' and 'closest.topleft' values (issue #48)

    o   New 'transpose' argument for 'coords', TRUE by default (issue #54)

    o   Use text instead of Tcl/Tk progress bar by default (issue #51)

    o   Fix 'method = "density"' smoothing when called directly from 'roc' (issue #49)

    o   Renamed 'roc' argument 'n' to 'smooth.n'

    o   Fixed 'are.paired' ignoring smoothing arguments of 'roc2' with 'return.paired.rocs'

    o   New 'ret' option "all" in 'coords' (issue #47)

    o   'drop' in 'coords' now drops the dimension of 'ret' too (#issue 43)

                 Changes in version 1.14.0 (2019-03-12)                 

    o   The 'multiclass.roc' function now accepts multivariate decision values (code contributed by Matthias Döring)

    o   'ggroc' supports multiple aesthetics (issue #42)

    o   Make 'ggplot2' dependency optional

    o   CSuggested packages can be installed interactively when required

    o   Passing both 'cases' and 'controls' or 'response' and 'predictor' arguments is now an error

    o   Many small bug fixes

                 Changes in version 1.13.0 (2018-09-24)                 

    o   'roc' now returns 'NaN' when predictor contains infinite values (issue #30)

    o   Better handling of near-ties near +-Infinity and 0

    o   'ggroc' supports aes="group" to allow curves with identical aesthetics

                 Changes in version 1.12.1 (2018-05-06)                 

    o   Fix a regression causing the allocation of a very large vector (issue #29)

                 Changes in version 1.12.0 (2018-05-05)                 

    o   Fix bug that crashed DeLong calculations when predictor had near-ties close to the floating point precision limit that were rounded back to a predictor value (issue #25)

    o   Fix bug that crashed 'ci.auc' and 'var' if 'direction' was ">" and 'percent=TRUE' (issue #25)

    o   Fix bug causing 'ci' to return 'NaN' values with 'method="delong"' when cases or controls had a single observation (issue #27)

    o   Fix 'power.roc.curve' failed with curves having 'percent=TRUE'

    o   Fix 'ci(..., of="coords")' returned the 'ci' function instead of the CI

    o   C++ code now check for user interrupts regularly with Rcpp::checkUserInterrupt()

    o   Better error message for 'ci.coords' attempting to return 'threshold'

    o   New algorithm = 5 (used by default) chooses the algorithm based on the number of thresholds to avoid worst case with algorithm = 3

                 Changes in version 1.11.0 (2018-03-25)                 

    o   Added argument 'legacy.axes' to 'ggroc'

    o   Fix NOTE about 'apparent S3 methods exported but not registered' in 'R CMD check'

                 Changes in version 1.10.0 (2017-06-10)                 

    o   Basic ggplot2 support (one and multiple ROC curves)

    o   Implement 'precision' and 'recall' for 'coords'

    o   Fix: properly handle NAs in cases when passing cases/controls to 'roc' (thanks Thomas König for the report)

    o   Fix various minor bugs detected with new unit tests
	1.9.1 (2017-02-05)

    o   Fix: 'subset' and 'na.action' arguments now handled properly in 'roc.formula' (thanks Terry Therneau for the report)

    o   Added policies to handle the case where a ROC curve has multiple "best" threshold in 'ci' (thanks Nicola Toschi for the report)

    o   Support 'xlim' and 'ylim' gracefully in 'plot.roc'

    o   Improved validation of input class 'levels' and 'direction'; messages when auto-detecting, use 'quiet' to turn on

    o   Removed extraneous 'name' attribute on the 'p.value' (thanks Paweł Kleka for the report)

    o   Faster DeLong algorithm (code contributed by Stefan Siegert)

                  Changes in version 1.8 (2015-05-05)                   

    o   NAMESPACE now properly exports the methods as S3 methods.

    o   Now uses and works with 'requireNamespace'

    o   Add ability to supply two ordered factors with identical levels as control / cases

    o   Deprecate dangerous use of a matrix as response / predictor with a warning

    o   Forward 'best.method' and 'best.weights' arguments to 'coords' in 'ci.thresholds'

    o   Fix CITATION file as per CRAN request

    o   pAUC correction is undefined for partial AUC below the diagonal (result < 0.5) and now returns NA (with a warning). Thanks Vincenzo Lagani for the report.

                 Changes in version 1.7.3 (2014-06-13)                  

    o   Fixed AUC of binomial-smoothed ROC off by 100^2 (thanks Bao-Li Chang for the report)

    o   Fix print of logcondens-smoothed ROC

                 Changes in version 1.7.2 (2014-04-06)                  

    o   Fixed bug where 'ci.coords' with 'x="best"' would fail if one or more resampled ROC curve had multiple "best" thresholds

    o   Fixed bug in 'ci.coords': passing more than one value in 'x' now works

    o   Fixed typo in documentation of 'direction' argument to 'roc' (thanks Le Kang for the report)

    o   Add a warning when computing statistics of ROC curve with AUC = 1

    o   Require latest version of Rcpp to avoid weird errors (thanks Tom Liptrot for the report)

                 Changes in version 1.7.1 (2014-02-21)                  

    o   Close SOCK cluster on Windows with parallel=TRUE

    o   Fixed really use algorithm 1 when microbenchmark fails

                         Changes in version 1.7                         

    o   Faster algorithm for DeLong 'roc.test', 'power.roc.test', 'ci.auc', 'var' and 'cov' function (no large matrix allocation)

    o   Handling Math and Operations correctly on 'auc' and 'ci' objects (see '?groupGeneric.pROC')

    o   The 'formula' for 'roc.formula' can now provide several predictors and a list of ROC curves will be returned

    o   Fixed documentation of 'ci.coords' with examples

    o   Fixed binormal AUC computed with triangulation despite the claim in the documentation

    o   Fixed unstated requirement on Rcpp >= 0.10.5

                Changes in version 1.6.0.1 (2013-12-28)                 

    o   Removed erroneous error message displayed when predictors and responses were not vectors

                  Changes in version 1.6 (2013-12-26)                   

    o   New 'power.roc.test' function for sample size and power computations

    o   New 'cov' and 'var' functions supports new "obuchowski" method

    o   New 'ci.coords' function to compute CI of arbitrary coords

    o   'coords' accepts new 'ret' value "1-accuracy"

    o   Introducing various algorithms to compute sensitivities and specificites, with a more vectorized code or Rcpp. See 'algorithm' in ?roc for more details on the trade-offs of the different methods.

    o   Faster algorithm for DeLong 'roc.test', 'ci', 'var' and 'cov' function (thanks Kazuki Yoshida).

    o   'are.paired' now also checks for identical 'levels'

    o   Fixed a warning generated in the examples

    o   Fixed several bugs related with 'smooth.roc' curves

    o   Additional input data sanity checks

    o   Now requires R >= 2.13 (in fact, since 1.5.1, thanks Emmanuel Curis for the report)

    o   Progress bars now defaults to text on Macs where 'tcltk' seems broken (thanks Gerard Smits for the report)

                 Changes in version 1.5.4 (2012-09-10)                  

    o   Running less smooth.roc examples with logcondens because they take too much time (requested by Uwe Ligges)

                        Changes in version 1.5.3                        

    o   AUC specification was lost when roc.test, cov or var was passed an 'auc' object.

    o   Correct computation of "accuracy" in 'coords' (thanks to Kosuke Yoshihara for the report)

                 Changes in version 1.5.1 (2012-03-09)                  

    o   Faster loading of the package (thanks to Prof Brian Ripley and Glenn Lawyer for the report)

                  Changes in version 1.5 (2011-12-12)                   

    o   New 'cov' and 'var' functions

    o   'coords' accepts new 'ret' values: "accuracy", "tn", "tp", "fn", "fp", "npv", "ppv", "1-specificity", "1-sensitivity", "1-npv", "1-ppv", "npe" and "ppe"

    o   New 'legacy.axes' argument to 'plot' 1-specificity rather than specificity

    o   New 'axes' argument to turn off the plotting of the axis

    o   New 'logcondens' and 'logcondens.smooth' (Univariate Log-Concave Density Estimation) smoothing methods

    o   New function 'has.partial.auc' to determine if an AUC is full or partial

    o   New argument 'drop' for 'coords'

    o   'auc' and 'multiclass.auc' objects now also have secondary class 'numeric'

    o   Updated load call

    o   Delong's CI reversed in ROC curves with direction=">"

    o   Delong's CI AUC returned values > 1 or < 0 in some rare cases

    o   Minor improvements in documentation

                 Changes in version 1.4.4 (2011-08-10)                  

    o   Fixed alternative for one-tailed tests (thanks to Lisa Koch for the report)

    o   Removed COPYING file to fix a warning in r-devel.

                 Changes in version 1.4.3 (2011-03-19)                  

    o   Updated citation

                 Changes in version 1.4.2 (2011-03-04)                  

    o   Fixed bootstrap 'roc.test' generating NAs when 'smooth.roc's were used with 'reuse.auc=FALSE' (thanks to Buddy for the report)

    o   Documented a warning that was missing in roc.test

    o   Updated citation

                 Changes in version 1.4.1 (2011-01-27)                  

    o   'venkatraman''s test for unpaired ROC curves

                  Changes in version 1.4 (2011-01-21)                   

    o   'smooth' does not apply on 'ordered' factors anymore

    o   Multi-class AUC support

    o   Can choose how 'best' thresold is determined ('best.method' and 'best.weights' in 'coords' and 'print.thres.best.method' and 'print.thres.best.weights' in 'plot.roc')

    o   Minor fixes in documentation

    o   'print' now prints the response instead of "response" and more informative data in 'htest's

    o   Bootstrap with 'ci.auc' consumes much less memory

    o   Unpaired bootstrap and DeLong's test

    o   Specificity and sensitivity tests (in 'roc.test')

                 Changes in version 1.3.2 (2010-08-24)                  

    o   'print.auc' printed incorrect CI in 'plot.roc' (thanks to Alexander B. Leichtle for the report)

    o   Failed to detect local maximas in 'coords' when 2 or less points were selected

    o   Don't consider ROC extremities (+-Inf at 1.0/0.0 SE<->SP) as local maximas

                 Changes in version 1.3.1 (2010-08-18)                  

    o   Sensitivity and specificity were inverted in coords when results were reported as list

    o   Faster checks with '\dontrun{}' in 'roc.test'

                  Changes in version 1.3 (2010-08-13)                   

    o   '...' not passed correctly in 'plot.ci.se' with 'type="bars"' resulting in an error

    o   CI is not re-computed by default in 'smooth.roc'. You can still turn it on with 'reuse.ci=TRUE'

    o   New function 'are.paired'

    o   Local maximas could be incorrectly detected in 'coords' (and 'plot.roc') with 'predictor's containing more than 2 levels.

    o   New method 'venkatraman' for 'roc.test'

    o   MASS and tcltk packages are now only suggested instead of required

                 Changes in version 1.2.1 (2010-05-11)                  

    o   Handle 'method' arguments for 'smooth.roc' and 'ci.auc' separately in 'roc.default'

    o   Added 'auc.polygon.*' and 'max.auc.polygon.*' arguments for 'polygon' in 'plot.roc'

                  Changes in version 1.2 (2010-05-09)                   

    o   Added DeLong method in 'ci.auc'

    o   Return value of 'ci.auc' does not contain an 'aucs' item anymore

    o   Put most examples with bootstrap within '\dontrun{}' blocks for faster (but less useful) checks execution

                  Changes in version 1.1 (2010-05-06)                   

    o   Added 'lines.roc' functions for ROC

    o   Added 'type' argument for both 'lines.roc' and 'plot.roc'

    o   Added 'print.auc.col' argument to 'plot.roc'

    o   Fixed a warning in 'roc.test.default' when the class of 'predictor1' had several elements

    o   Fixed an encoding failure during the checks on MacOS X

                 Changes in version 1.0.1 (2010-04-28)                  

    o   Reduced examples execution time. Added low 'boot.n' in the slowest examples and 'reuse.auc' and 'reuse.ci' arguments in smooth.roc.roc

                         Changes in version 1.0                         

    o   First public release
