Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
48 0 0 2 95.8% 17.87 s

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
net.stoerr.chatgpt.codevengine 48 0 0 2 95.8% 17.87 s

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

net.stoerr.chatgpt.codevengine

- Class Tests Errors Failures Skipped Success Rate Time
ExecuteExternalActionIT 7 0 0 0 100% 2.550 s
ReplaceRegexActionIT 1 0 0 1 0% 0.001 s
WriteFileActionIT 3 0 0 0 100% 1.471 s
ListFilesActionIT 12 0 0 0 100% 4.391 s
ReplaceActionIT 5 0 0 0 100% 1.883 s
GrepActionIT 7 0 0 0 100% 2.251 s
ReadFileActionIT 4 0 0 0 100% 1.603 s
UrlActionIT 5 0 0 1 80.0% 2.067 s
CoDeveloperEngineGeneralIT 4 0 0 0 100% 1.655 s

Test Cases

[Summary] [Package List] [Test Cases]

ExecuteExternalActionIT

testHelloWorldWithLargeFileAndCut 0.453 s
testExecuteActionFail 0.205 s
testExecuteActionHelloWorldWithArguments 0.206 s
testHelloWorldWithLargeFile 0.209 s
testExecuteActionHelloWorld 0.205 s
testExecuteActionJsonError 0.203 s
testExecuteActionNotThere 0.202 s

ReplaceRegexActionIT

- 0 s
- ReplaceRegexActionIT is disabled since ReplaceRegexAction isn't active because of too many errors made by ChatGPT. -

WriteFileActionIT

testAppendToFile 0.212 s
testWriteLargeFile 0.207 s
testWriteFileOperation 0.203 s

ListFilesActionIT

testListFilesOperationBothRegex 0.668 s
testListFilesOperationFilePathRegex 0.207 s
testInvalidPath 0.211 s
testListFilesOperationGrepRegex 0.208 s
testFileRegexNotFound 0.208 s
testListFilesOperationRootNonrecursive 0.204 s
testListFilesOperationSubdir 0.204 s
testGrepRegexNotFound 0.205 s
testListFilesOperationRoot 0.205 s
testBrokenGrepRegex 0.203 s
testBrokenFileRegex 0.204 s
testDirectories 0.203 s

ReplaceActionIT

testComplainAboutMultiplesSinceManyMatches 0.210 s
testReplaceOperationFileNotFound 0.204 s
testReplaceOperation 0.206 s
testComplainAboutMultiplesSinceNoMatch 0.202 s
testMultipleReplacementsInOneRequest 0.205 s

GrepActionIT

testBrokenFilePathRegex 0.203 s
testGrepOperationContext 0.206 s
testNotExistingGrepRegex 0.203 s
testWrongFilename 0.203 s
testFileRegexNotMatching 0.203 s
testGrepOperationFirstFile 0.204 s
testBrokenGrepRegex 0.203 s

ReadFileActionIT

testReadWithStartLine 0.205 s
testReadWithMaxLinesAndStartLine 0.203 s
testReadWithoutParameters 0.203 s
testReadWithMaxLines 0.208 s

UrlActionIT

testValidUrl 0.463 s
testUrlWithoutProtocol 0.213 s
testPdfUrl 0 s
- Takes a looong time -
testInvalidUrl 0.218 s
testValidUrlRaw 0.209 s

CoDeveloperEngineGeneralIT

testAiPluginJson 0.211 s
testRoot 0.209 s
testUnknownRequest 0.209 s
testCoDeveloperEngineYaml 0.208 s

Failure Details

[Summary] [Package List] [Test Cases]


- skipped: ReplaceRegexActionIT is disabled since ReplaceRegexAction isn't active because of too many errors made by ChatGPT.
testPdfUrl
- skipped: Takes a looong time