Reporting

118 Topics

Ramping up your usage of SOAP UI NG ? Check out our Free weekly Training webinar!
Hello all, Have you recently bought new Ready! API licenses and are about to kick start your API tests? Register here for our Free Weekly interactive Webinar, Next one is on the 7th of September( day after Labor day) What to expect? Advice on getting up and running on your SOAP and REST projects Hidden gems within the tool that you may not uncover on your own Personalized question-and-answer with our API experts If you have 10+ users and would like to get your users on-boarded, please reply to this message and I'll be in touch. Cheers, Katleen B Snr. Customer Success Advisor EMEA kbb(at)smartbear.com
katleenbb
9 years ago Place ReadyAPI Questions
1.4KViews
2likes
0Comments
Broken links in test results HTML generated by testrunner.bat
There are broken links in the HTML test results generated by testrunner.bat In Windows, using ReadyAPI version 3.48 How to reproduce: 1 - Create a project that has a period in its name (e.g. Project1.0) 2 - Run the tests through the commandline, using testrunner.bat with the flags -A -r -j -I -f <output file> "-RJUnit-Style HTML Report" -FXML <project file> 3 - Open the index.html on a browser There are broken links in the HTML (they can also be seen directly in the "frame" html files that have been generated in the test results output directory). The reason they are broken is that the period "." character in the project name (and corresponding directory now created in the test results directory) has been replaced with a "/".
odzer
11 months ago Place ReadyAPI Questions
185Views
1like
1Comment
Is it possible to set the test case failed reason that is used in the reports?
This question came up a couple of days ago when going through a TestSuite Report with other team members.Is it possible to set the test case failed reason to a custom message? Currently when a TestCase fails the report simply shows the reason as 'Failing due to failed test step', and I was asked "That's a bit vague, any chance of getting a more descriptivemessage there." This leads to another question, what other reasons are there? I checked back in a few reports and all I ever see is "Failing due to failed test step." I looked through the javadocs and gained no particular insight there. ps. I would love for there to be a "Curiosity" label for questions like these.😼
steve_rivers
2 years ago Place ReadyAPI Questions
335Views
1like
2Comments
How to set single-page JUnit report format in Groovy script
I want to generate a single-page JUnit report from a Groovy script. I am able to useJUnitReportEngine and generate a multiple-pages report, which is the default format. However, I am not able to set SINGLE_PAGE_PRINT_REPORT_FORMAT. There's no appropriate parameter in constructor, I have also tried to set it up in GeneratableJUnitReport method generate as a jrFormats parameter: generate(Settingssettings, java.lang.String[] jrFormats, java.lang.String folder) In the SDK (links above) there's no documentation how to do that. Can you please advise?
KarelHusa
2 years ago Place ReadyAPI Questions
685Views
1like
2Comments
How to configure gitlab pipeline for ReadyAPI from TestRunner
We are trying to configure gitlab pipeline for ReadyAPI from TestRunner commandline , We have added below code into the ".gitlab-ci.yml" file in gitLab ------------------------------- stages: - build - test build: stage: build script: - echo "Building Pipeline" test: stage: test script: - echo "Testing Pipeline" - chmod +x "PATH TO testrunner.bat" -a "-f PATH TO \Test Reports" "-RProject Report" -FPDF -E PATH TO PROJECT FILE --------------------------------- The code is commited to GitLab. When i run the Pipeline the execution is failed due to below Reason: -------------------------------------- chmod: invalid option -- a BusyBox v1.32.0 (2020-11-23 21:18:59 UTC) multi-call binary. Usage: chmod [-Rcvf] MODE[,MODE]... FILE... Each MODE is one or more of the letters ugoa, one of the symbols +-= and one or more of the letters rwxst -R Recurse -c List changed files -v List all files -f Hide errors ERROR: Job failed: exit code 1 ------------------------------ Could anyone please provide the solution for this. Vallalarasu_P
vinodkn
3 years ago Place ReadyAPI Questions
1.3KViews
1like
5Comments
Report not generated from security test runner batch file
This is more of an intriguing question rather than a blocker as I have a work around Since there doesn't seem to be a way to run ReadyAPI load or security tests from QA Complete I am investigating running them from a groovy script creating a process and running the appropriate testrunner.bat file. Initially I created a groovy script as follows (took me a while to figure out how to get the runner output to the log window and i'm sure there are better ways) def testRunnerPath = 'C:\\Program Files\\SmartBear\\ReadyAPI-3.20.2\\bin' def suite='-sSecurity' def testcase = '-cAutomationTest' def securityTest = '-nAutomationTest' def reportLoc = '-fC:\\repos\\Reports' def reportType = '-R"SecurityTest Report"' def reportFormat = '-FPDF' def env = '-Eperf' def project = 'C:\\repos\\compositeprojectdir' def args = ['cmd.exe','/c', 'securitytestrunner.bat', suite, testcase, securityTest, reportLoc, reportType, reportFormat, env, project] def pb = new ProcessBuilder( args ) pb.directory(new File(testRunnerPath)) log.info pb.command() try { log.info "Start..." Process process = pb.start() process.in.withReader { r -> r.eachLine { line -> if(line.contains("WARN")) { log.warn "batch file output> ${line}" } else if (line.contains("ERROR")) { log.error "batch file output> ${line}" } else { log.info "batch file output> ${line}" } } } process.waitForProcessOutput(System.out, System.err) } catch (IOException e) { log.warn ("Process killed before completing! ${e}") } catch (Exception e) { log.warn ("Process killed before completing! ${e}") } finally { log.info "End..." } This runs the security test with one small problem, the report generation step does not run. However, when, after banging my head against this problem for most of the day I created a simple batch file with the command generated from the test runner UI and just ran that batch file from the groovy script the report generated correctly def args = ['cmd.exe','/c', 'C:\\repos\\compositeprojectdir\\BatchFiles\\SecurityTest.bat' ] def pb = new ProcessBuilder( args ) log.info pb.command() try { log.info "Start..." Process process = pb.start() process.in.withReader { r -> r.eachLine { line -> if(line.contains("WARN")) { log.warn "batch file output> ${line}" } else if (line.contains("ERROR")) { log.error "batch file output> ${line}" } else { log.info "batch file output> ${line}" } } } process.waitForProcessOutput(System.out, System.err) } catch (IOException e) { log.warn ("Process killed before completing! ${e}") } catch (Exception e) { log.warn ("Process killed before completing! ${e}") } finally { log.info "End..." } Batch file Echo off "C:\Program Files\SmartBear\ReadyAPI-3.20.2\bin\securitytestrunner.bat" -sSecurity -cAutomationTest -nAutomationTest -fC:\repos\Reports -R"SecurityTest Report" -FPDF -Eperf C:\repos\compositeprojectdir This works and generates the report in the right place and I can work with this. So, either I am missing something really obvious and will hang my head in shame when it is pointed out or there is something subtle going on that I don't understand.
Solved
steve_rivers
3 years ago Place ReadyAPI Questions
784Views
1like
1Comment