Failsafe Report

Summary

[Summary] [Package List] [Test Cases]


Tests Errors Failures Skipped Success Rate Time
48 0 0 2 95.8% 18.09 s

Note: failures are anticipated and checked for with assertions while errors are unanticipated.


Package List

[Summary] [Package List] [Test Cases]


Package Tests Errors Failures Skipped Success Rate Time
net.stoerr.chatgpt.codevengine 48 0 0 2 95.8% 18.09 s

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.

net.stoerr.chatgpt.codevengine

- Class Tests Errors Failures Skipped Success Rate Time
ReplaceActionIT 5 0 0 0 100% 1.959 s
CoDeveloperEngineGeneralIT 4 0 0 0 100% 1.639 s
ExecuteExternalActionIT 7 0 0 0 100% 2.597 s
GrepActionIT 7 0 0 0 100% 2.353 s
UrlActionIT 5 0 0 1 80.0% 2.150 s
ReadFileActionIT 4 0 0 0 100% 1.677 s
ReplaceRegexActionIT 1 0 0 1 0% 0 s
WriteFileActionIT 3 0 0 0 100% 2.487 s
ListFilesActionIT 12 0 0 0 100% 3.226 s

Test Cases

[Summary] [Package List] [Test Cases]

ReplaceActionIT

testComplainAboutMultiplesSinceManyMatches 0.212 s
testReplaceOperationFileNotFound 0.204 s
testReplaceOperation 0.205 s
testComplainAboutMultiplesSinceNoMatch 0.204 s
testMultipleReplacementsInOneRequest 0.206 s

CoDeveloperEngineGeneralIT

testAiPluginJson 0.210 s
testRoot 0.207 s
testUnknownRequest 0.207 s
testCoDeveloperEngineYaml 0.206 s

ExecuteExternalActionIT

testHelloWorldWithLargeFileAndCut 0.590 s
testExecuteActionFail 0.206 s
testExecuteActionHelloWorldWithArguments 0.207 s
testHelloWorldWithLargeFile 0.210 s
testExecuteActionHelloWorld 0.207 s
testExecuteActionJsonError 0.203 s
testExecuteActionNotThere 0.204 s

GrepActionIT

testBrokenFilePathRegex 0.205 s
testGrepOperationContext 0.297 s
testNotExistingGrepRegex 0.205 s
testWrongFilename 0.210 s
testFileRegexNotMatching 0.206 s
testGrepOperationFirstFile 0.206 s
testBrokenGrepRegex 0.204 s

UrlActionIT

testValidUrl 0.578 s
testUrlWithoutProtocol 0.228 s
testPdfUrl 0 s
- Takes a looong time -
testInvalidUrl 0.277 s
testValidUrlRaw 0.217 s

ReadFileActionIT

testReadWithStartLine 0.206 s
testReadWithMaxLinesAndStartLine 0.205 s
testReadWithoutParameters 0.204 s
testReadWithMaxLines 0.212 s

ReplaceRegexActionIT

- 0 s
- ReplaceRegexActionIT is disabled since ReplaceRegexAction isn't active because of too many errors made by ChatGPT. -

WriteFileActionIT

testAppendToFile 0.658 s
testWriteLargeFile 0.212 s
testWriteFileOperation 0.205 s

ListFilesActionIT

testListFilesOperationBothRegex 0.207 s
testListFilesOperationFilePathRegex 0.205 s
testInvalidPath 0.205 s
testListFilesOperationGrepRegex 0.205 s
testFileRegexNotFound 0.204 s
testListFilesOperationRootNonrecursive 0.204 s
testListFilesOperationSubdir 0.204 s
testGrepRegexNotFound 0.205 s
testListFilesOperationRoot 0.204 s
testBrokenGrepRegex 0.203 s
testBrokenFileRegex 0.203 s
testDirectories 0.204 s

Failure Details

[Summary] [Package List] [Test Cases]


testPdfUrl
- skipped: Takes a looong time
- skipped: ReplaceRegexActionIT is disabled since ReplaceRegexAction isn't active because of too many errors made by ChatGPT.