<div class="post-toc-block float-default with-border"> 
						<div class="post-toc-header">Table of Contents</div>
						<nav id="md-post-toc" class="md-post-toc"></nav>
						</div><p>NYC, often referred to as Istanbul&#8217;s command-line interface (CLI), is a powerful code coverage tool designed specifically for JavaScript testing. It works seamlessly with testing frameworks like Mocha, Jest, and Ava, making it an invaluable resource for developers looking to measure and improve the coverage of their tests. NYC not only tracks how much of your code is covered by your existing test suite but also provides detailed reports that help identify untested parts of your codebase.</p>
<p>NYC offers a variety of output formats for its reports, including text summaries, detailed HTML pages, and JSON summaries, each providing different levels of detail and visual representation to suit various development and review processes. This flexibility makes NYC not just a tool for tracking test coverage, but also a vital part of continuous integration pipelines, ensuring that new code meets quality standards before it is merged.</p>
<p>Users can configure NYC extensively via <code>.nycrc</code> or package.json files, allowing them to tailor coverage criteria, reporting formats, and instrumenter options to fit their project&#8217;s needs.</p>
<h2>Collecting Coverage for test scripts built using mocha</h2>
<p>we will now create a sample test to demonstrate how to generate coverage data for tests made using mocha. Refer <a href="https://istanbul.js.org/docs/tutorials/">https://istanbul.js.org/docs/tutorials/</a> for tutorials to use nyc with different testing frameworks.</p>
<p>The example project can be found on <a href="https://github.com/AkashKumar7902/nyc-mocha">https://github.com/AkashKumar7902/nyc-mocha</a></p>
<p>here is the test file for a simple <code>arithmetic.js</code> :</p>
<pre><code class="language-javascript">const assert = require(&#039;assert&#039;);
const Arithmetic = require(&#039;./arithmetic&#039;);

describe(&#039;Arithmetic&#039;, function () {
    describe(&#039;#add()&#039;, function () {
        it(&#039;should return the sum of two numbers&#039;, function () {
            assert.strictEqual(Arithmetic.add(1, 1), 2);
        });
    });

    describe(&#039;#subtract()&#039;, function () {
        it(&#039;should return the difference of two numbers&#039;, function () {
            assert.strictEqual(Arithmetic.subtract(5, 3), 2);
        });
    });

    describe(&#039;#multiply()&#039;, function () {
        it(&#039;should return the product of two numbers&#039;, function () {
            assert.strictEqual(Arithmetic.multiply(4, 3), 12);
        });
    });
});</code></pre>
<p>To run the tests with mocha change &quot;test&quot; script in package.json to:</p>
<pre><code class="language-json">  &quot;scripts&quot;: {
    &quot;test&quot;: &quot;nyc --reporter=html --reporter=text mocha&quot;
  },</code></pre>
<p><em>here,</em><code>--reporter=html</code><em>flag creates a folder named</em><code>coverage</code><em>in the current working directory. To view the coverage data in html format, open coverage/index.html in your web browser.</em></p>
<p><em>and,</em><code>--reporter=text</code><em>displays the coverage data in a pretty format.</em></p>
<p>Execute <code>npm test</code> to initiate the predefined tests and produce a coverage report. Here&#8217;s what the output will look like:</p>
<pre><code class="language-bash">> nyc-mocha@1.0.0 test
> nyc --reporter=html --reporter=text mocha

  Arithmetic
    #add()
      ✔ should return the sum of two numbers
    #subtract()
      ✔ should return the difference of two numbers
    #multiply()
      ✔ should return the product of two numbers

  3 passing (3ms)

---------------|---------|----------|---------|---------|-------------------
File           | % Stmts | % Branch | % Funcs | % Lines | Uncovered Line #s 
---------------|---------|----------|---------|---------|-------------------
All files      |   57.14 |        0 |      75 |   57.14 |                   
 arithmetic.js |   57.14 |        0 |      75 |   57.14 | 15-18             
---------------|---------|----------|---------|---------|-------------------</code></pre>
<h2>Collecting coverage data for each request coming to a server</h2>
<p>Coverage data for each server run gets saved in the <code>.nyc_output</code> directory by default. In some e2e testing scenarios where server is restarted after every testset run, we can analyze the raw coverage files for each run and calculate overall coverage percentage.</p>
<p>Replaying test sets recorded with keploy starts the application each time and the coverage data for each run can be viewed from json files in <code>.nyc_output</code> . But not all json files in the nyc folder is useful (most of them are empty), to determine the useful json&#8217;s we have to analyze the corresponding files in <code>.nyc_output/processinfo</code>. The files in this directory lists the process metadata and the files which are instrumented during the process run. we can mark the filename&#8217;s as useful by checking if the <code>files</code> array in the processinfo json contains any element or not. Once we have this information, we can process the data in the useful json&#8217;s and calculate the coverage percentage.</p>
<p>Below is the implementation of the above approach in go:</p>
<pre><code class="language-go">func CalTypescriptCoverage() (models.TestCoverage, error) {
    testCov := models.TestCoverage{
        FileCov:  make(map[string]string),
        TotalCov: &quot;&quot;,
    }

    coverageFilePaths, err := getCoverageFilePathsTypescript(filepath.Join(&quot;.&quot;, &quot;.nyc_output&quot;, &quot;processinfo&quot;))
    if err != nil {
        return testCov, err
    }
    if len(coverageFilePaths) == 0 {
        return testCov, fmt.Errorf(&quot;no coverage files found&quot;)
    }

    // coverage is calculated as: (no of statements covered / total no of statements) * 100
    // no of statements covered is the no of entries in S which has a value greater than 0
    // Total no of statements is len of S

    linesCoveredPerFile := make(map[string]map[string]bool) // filename -&gt; line -&gt; covered/not covered

    for _, coverageFilePath := range coverageFilePaths {

        coverageData, err := os.ReadFile(coverageFilePath)
        if err != nil {
            return testCov, err
        }
        var cov TypescriptCoverage
        err = json.Unmarshal(coverageData, &amp;cov)
        if err != nil {
            return testCov, err
        }

        for filename, file := range cov {
            if _, ok := linesCoveredPerFile[filename]; !ok {
                linesCoveredPerFile[filename] = make(map[string]bool)
            }
            for line, isStatementCovered := range file.S {
                if _, ok := linesCoveredPerFile[filename][line]; !ok {
                    linesCoveredPerFile[filename][line] = false
                }
                if isStatementCovered.(float64) &gt; 0 {
                    linesCoveredPerFile[filename][line] = true
                }
            }
        }
    }

    totalLines := 0
    totalCoveredLines := 0
    coveredLinesPerFile := make(map[string]int) // filename -&gt; no of covered lines
    for filename, lines := range linesCoveredPerFile {
        for _, isCovered := range lines {
            totalLines++
            if isCovered {
                totalCoveredLines++
                coveredLinesPerFile[filename]++
            }
        }
    }

    for filename, lines := range linesCoveredPerFile {
        testCov.FileCov[filename] = strconv.FormatFloat(float64(coveredLinesPerFile[filename]*100)/float64(len(lines)), &#039;f&#039;, 2, 64) + &quot;%&quot;
    }
    testCov.TotalCov = strconv.FormatFloat(float64(totalCoveredLines*100)/float64(totalLines), &#039;f&#039;, 2, 64) + &quot;%&quot;
    return testCov, nil
}</code></pre>
<p><em>here,</em><code>TypescriptCoverage</code><em>is a struct which depicts the structure of the json in .nyc_output folder.</em></p>
<p>and, <code>getCoverageFilePathsTypescript</code> function is used to get the file paths of the useful json. Here is the implementation:</p>
<pre><code class="language-go">func getCoverageFilePathsTypescript(path string) ([]string, error) {
    filePaths := []string{}
    walkfn := func(path string, info os.FileInfo, err error) error {
        if !info.IsDir() &amp;&amp; !strings.HasSuffix(path, &quot;index.json&quot;) {
            fileData, err := os.ReadFile(path)
            if err != nil {
                return err
            }
            var processInfo ProcessInfo
            err = json.Unmarshal(fileData, &amp;processInfo)
            if err != nil {
                return err
            }
            if len(processInfo.Files) &gt; 0 {
                filePaths = append(filePaths, processInfo.CoverageFilename)
            }
        }
        return nil
    }
    err := filepath.Walk(path, walkfn)
    if err != nil {
        return nil, err
    }
    return filePaths, nil
}</code></pre>
<h2>Conclusion</h2>
<p>To conclude, NYC serves as a comprehensive tool for monitoring and improving code coverage across JavaScript and TypeScript projects. By integrating with popular testing frameworks like Mocha, it facilitates the generation of detailed coverage reports in various formats, enhancing the quality assurance process. These reports not only highlight the covered sections of code but also pinpoint areas lacking tests, guiding developers towards more robust software development.</p>
<p>Additionally, with the ability to replay test sets using Keploy and analyze coverage data through generated JSON files in the <code>.nyc_output</code> directory, developers can effectively manage and optimize test coverage.</p>
<h2>FAQ’s</h2>
<h3><strong>What is NYC in JavaScript testing?</strong></h3>
<p>NYC, Istanbul&#8217;s CLI, is a powerful code coverage tool for JavaScript testing frameworks like Mocha, Jest, and Ava. It tracks and reports test coverage, identifying untested parts of the codebase.</p>
<h3><strong>How do I configure NYC for a Mocha test suite?</strong></h3>
<p>Add <code>&quot;test&quot;: &quot;nyc --reporter=html --reporter=text mocha&quot;</code> to the <code>scripts</code> section in your <code>package.json</code>. Run <code>npm test</code> to generate coverage reports in text and HTML formats.</p>
<h3><strong>What output formats does NYC support for coverage reports?</strong></h3>
<p>NYC provides various report formats, including text summaries, detailed HTML pages, and JSON summaries, allowing flexibility for development and review workflows.</p>
<h3><strong>Can NYC analyze server-side test coverage?</strong></h3>
<p>Yes, NYC can collect server-side test coverage data. The <code>.nyc_output</code> directory stores coverage files for each server run, which can be analyzed to calculate overall test coverage.</p>
<h3><strong>How does Keploy integrate with NYC for test coverage?</strong></h3>
<p>Keploy replays test sets, restarting the server for each run. NYC captures coverage data, saved as JSON files in <code>.nyc_output</code>, which can be processed to calculate test coverage percentages effectively.</p>

         
        
                    

                    
                    <div class="pp-multiple-authors-boxes-wrapper pp-multiple-authors-wrapper pp-multiple-authors-layout-boxed multiple-authors-target-the-content box-post-id-16 box-instance-id-1 ppma_boxes_16"
                    data-post_id="16"
                    data-instance_id="1"
                    data-additional_class="pp-multiple-authors-layout-boxed.multiple-authors-target-the-content"
                    data-original_class="pp-multiple-authors-boxes-wrapper pp-multiple-authors-wrapper box-post-id-16 box-instance-id-1">
                                                                                    <h2 class="widget-title box-header-title">Author</h2>
                                                                            <span class="ppma-layout-prefix"></span>
                        <div class="ppma-author-category-wrap">
                                                                                                <span class="ppma-category-group ppma-category-group-">
                                                                                                                        <ul class="pp-multiple-authors-boxes-ul">
                                                                                                                                                                                                                                                                                                                                                                                                                    <li class="pp-multiple-authors-boxes-li author_index_0 author_akash-kumar has-avatar">
                                                                                                                                                                                                                                            <div class="pp-author-boxes-avatar">
                                                                                                                                            <img alt='Akash Kumar' src='https://wp.keploy.io/wp-content/uploads/2024/10/Gravatar-Logo.jpg' srcset='https://wp.keploy.io/wp-content/uploads/2024/10/Gravatar-Logo.jpg' class='multiple_authors_guest_author_avatar avatar' height='80' width='80'/>                                                                                                                                    </div>
                                                            
                                                            <div class="pp-author-boxes-avatar-details">
                                                                                                                                                                                                <div class="pp-author-boxes-name multiple-authors-name">
                                                                        <a href="https://wp.keploy.io/author/akash-kumar/" rel="author" title="Akash Kumar" class="author url fn">Akash Kumar</a> 
                                                                    </div>
                                                                                                                                                                                                                                                                    <p class="pp-author-boxes-description multiple-authors-description">
                                                                                                                                            </p>
                                                                                                                                
                                                                                                                                
                                                                                                                            </div>
                                                                                                                                                                                                                                                                                                                                                                                                             </li>
                                                                                                                                                                                                                                    </ul>
                                                                            </span>
                                                                                    </div>
                    <span class="ppma-layout-suffix"></span>
                    </div>
                    
                    
                
                                <style>
                .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-author-boxes-avatar img { width: 80px !important; height: 80px !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-author-boxes-avatar img { border-style: none !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-author-boxes-avatar img { border-radius: 50% !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-author-boxes-meta a { background-color: #655997 !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-author-boxes-meta a { color: #ffffff !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-author-boxes-meta a:hover { color: #ffffff !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .ppma-author-user_email-profile-data { background-color: #655997 !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .ppma-author-user_email-profile-data { border-radius: 100% !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .ppma-author-user_email-profile-data { color: #ffffff !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .ppma-author-user_url-profile-data { background-color: #655997 !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .ppma-author-user_url-profile-data { border-radius: 100% !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .ppma-author-user_url-profile-data { color: #ffffff !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-author-boxes-recent-posts-title { border-bottom-style: dotted !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-multiple-authors-boxes-li { border-style: solid !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-multiple-authors-boxes-li { border-width: 1px !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-multiple-authors-boxes-li { border-color: #999 !important; } .pp-multiple-authors-boxes-wrapper.box-post-id-16.pp-multiple-authors-layout-boxed.multiple-authors-target-the-content.box-instance-id-1 .pp-multiple-authors-boxes-li { color: #3c434a !important; }             </style>

Mastering NYC: Enhance JavaScript & TypeScript Test Coverage

Python Automation Testing Guide

Quality Assurance Testing: Everything You Need to Know

Reliability Testing – A Complete Guide

Master JavaScript filter() Method: Guide with Examples

Latency Testing Guide for Faster Apps

What is a Flaky Test? Causes, Impacts & How to Deal with Them

Ad Hoc Testing: A Quick Guide to Finding Hidden Bugs

Building Keploy.io, an EBPF based open source framework to generate test cases and data stubs from API calls.

Neha Gupta

Cloud technology veteran and probably the youngest (globally) to have completed all 5 AWS certifications (including Solutions architect Professional and Dev­ops engineer professional)

Mastering Nyc: Enhance Javascript & Typescript Test Coverage

More Stories