Jama Connect Interchange™: Live Traceability™ Realized
The #1 problem product engineering organizations face is complying with traceability requirements spanning siloed teams and tools. Organizations are often encumbered by the highly manual and time-consuming review of information across numerous spreadsheets.
What is Live Traceability?
Jama Software defines Live Traceability ™ as the ability to see the most up-to-dateand complete upstream and downstream information for any requirement, no matter the stage of systems development or how many siloed tools and teams it spans.
This enables engineering and product management processes to be managed through data and to improve performance in real-time.
How Can We Extend Live Traceability using Jama Connect Interchange?
Jama ConnectInterchange™ is purpose-built to deliver Live Traceability across siloed teams and best-of-breed tools, including Microsoft Excel. By using Jama Connect Interchange, teams can simplify this process by linking data across multiple product development applications.
Best-of-Breed Tools That Plug into Jama Connect for Live Traceability
By utilizing Jama Connect Interchange, teams can now leverage the power of Jama Connect’s traceability model to continuously sync traceable information from other tools with no change required for engineering disciplines to continue using their chosen tools to maximize productivity.
To stay up-to-date on future integration tools available with Jama Connect Interchange, follow the Release Notes in our Community!
The Key Benefits of Jama Connect Interchange
Live Traceability
Overcome siloed information to support your product development lifecycle from user and market needs to verification and validation.
Data Integrity
Run complex calculations, logic statements, and other Excel operations from within Jama Connect. All standard Excel functions are supported, and values flow automatically, so you can utilize the full power of Excel without leaving Jama Connect.
Speed
Align teams, track decisions efficiently, and minimize rework to create high-quality products on time and on budget.
Adaptability
Easily adapt Jama Connect to your project and organizational workflows to create an intuitive experience so your teams can get up to speed quickly.
Requirements in a Single System of Record
Achieve and maintain alignment with real-time updates across teams and tools in a single location.
Common Jama Connect Interchange Use Case
Configurable Sync
One-way or bidirectional sync to match your workflows; set the sync frequency to match the speed of your business
Rich Data and Formatting
Supports text formatting, tables, bullets/ numbering, and text transformation
Simple Configuration
Quick setup wizard, control panel, and field mapping tools – all backed by auditable logs
Unlike other solutions in the market, Jama Connect Interchange has been specifically designed and developed to work seamlessly with Jama Connect. It’s easy to deploy, configure, use, and expand – driving efficiency and further lowering your total cost of ownership.
https://www-dev.jamasoftware.com/media/2022/06/2022-06-09-v2-jama-connect-interchange-1.jpg5121024Jama Software/media/jama-logo-primary.svgJama Software2022-06-09 03:00:492023-01-12 16:46:38Jama Connect Interchange™: Live Traceability™ Realized
Jama Software® Enables Measurable Performance Improvement with Client-Specific Success Paths
We’re excited to announce our further advancement to our market-leading customer success program that has led to high levels of customer retention and award-winning customer satisfaction. Our customers are now able to define measurable success paths from a catalog of consulting offerings to derive optimum and continuous value from Jama Connect®. The new Jama Software Success Program helps customers accelerate the best possible business outcomes and realize long-term success.
With the Jama Software Success Program, customers can now select the success path that best maps to the level of collaboration required to meet their unique needs and desired business outcomes. These customizable success paths deliver the industry-specific expertise, guidance, and resources clients need to see a quick return on investment and achieve their goals.
The Jama Software Success Program has three primary offerings:
Essentials Success – A foundational self-guided success path with access to key resources, tutorials, and training to set customers on the road to success.
Guided Success – A guided success path with enhanced resource offerings including benchmark assessments, personalized training offerings, and technical services to help evaluate compliance and improve process and quality.
Strategic Success – A strategic success path which provides even more advanced offerings, premium-level support, and a close partnership in complex and ongoing enterprise deployments to drive continuous process improvement across multiple projects.
To learn how Jama Software enables your company to succeed in a competitive market, CLICK HERE
With in-house industry experts, extensive consulting, training, and data-driven insights to measure and improve outcomes, the Jama Software Success Program enables customers to accelerate development, improve product quality, reduce risk, and manage innovation in systems engineering.
“With this program update, Jama Software now provides best practice engineering process improvement,” stated Tom Tseki, Chief Revenue Officer. “While other software companies are focused on just implementing their solutions, Jama Software is focused on providing measured process improvement for our customers that goes way beyond just the implementation of software.”
Live Traceability™ for Airborne Systems Development
Airborne systems are incorporating more cutting-edge technology and becoming more complex with advanced embedded computing technologies, electric propulsion systems, sensors and data, and airframes. A major percentage of this complexity is handled at the software level. Any error in the avionics software of safety-critical airborne electronics could be catastrophic to the aircraft, its occupants, or persons on the ground.
Airborne systems development requires developers to adhere to the most rigorous safety standards in the world. These extremely rigorous, plan-driven, development processes are unimaginable to developers who have not done it before. Certification is expensive. Delays in certification due to lack of evidence of following mandated guidelines could spell the demise of a new startup. Mistakes in design and development could cost lives. Manual documentation or the use of legacy tools introduce risk. Achieving certification for safety-critical airborne software is costly and time consuming. Once certification is achieved, the deployed software cannot be modified without recertification.
Airborne certification bodies such as the Federal Aviation Agency (FAA) and European Aviation Safety Agency (EASA) recognize international standards as “acceptable means, but not the only means, for showing compliance with the applicable airworthiness regulations for the software aspects of airborne systems and equipment certification.” The most common standards that are followed for airborne systems as a means of compliance are: RTC DO-178C (also published in Europe as EUROCAE ED-12C), DO-254 (also published in Europe as EUROCAE ED-80), and SAE 4754A (also published in Europe as EUROCAE ED-79) standards for Airborne systems.
Demonstration of traceability is fundamental to each of these standards as the evidence mechanism to demonstrate that safe design practices were followed. Jama Connect provides an efficient way to capture traceability in a “Live” manner as artifacts (requirements, tests, risks etc…) are being created. Manual document methods and legacy tools will require engineers to create the trace relationships after the development has been done. This could introduce risk as well as lengthen development times.
Traceability models assist users to create consistent traces between data, then query that data, and provide consistent trace nomenclature between different tools in the ecosystem. The standards are where to begin when defining a traceability model for airborne systems. For example, ARP4754A/ED-79 describes the identification of requirements at the aircraft level, system level, and at an item design level. These requirements interact and are “traced” to various safety related data as well as verification tests. In Jama Connect data artifacts called item types are defined to capture this data and a relationship ruleset is put in place to govern the traces and provide the facility to analyze and report on the traces.
ARP4754A process interactions between safety and development.
In Jama Connect data artifacts called item types are defined to capture this data and a relationship model is put in place to govern the traces and provide the facility to analyze and report on the traces. In the figure below the relationship model that Jama Connect automatically draws for you, the item types are: Function, Failure Analysis, System Architecture, System Requirement etc. The traces relationships are depicted as the lines between the items types.
The airborne systems software standard DO-178C/ED-12C requires a “documented connection” (called a trace) between the certification artifacts. In the figure below from DO-178C, users must document traces between system requirements and high level software requirements (HLR). HLRs must be traced to software low level requirements (LLR) as well as test cases and software architecture. LLRs must be traced to test cases and source code.
For example, a Low Level Requirement (LLR) traces up to a High Level Requirement (HLR). A traceability analysis is then used to ensure that each requirement is fulfilled by the source code, that each requirement is tested, that each line of source code has a purpose (is connected to a requirement), and so forth. Traceability ensures the system is complete. The rigor and detail of the certification artifacts is related to the software level.
DO-178 mandates requirements-based testing. Each requirement must have associated tests exercising both normal processing and error handling, to demonstrate that the requirement is met and that the invalid inputs are properly handled. The testing is focused on what the system is supposed to do, not the overall functionality of each module. In figure X the Jama Connect traceability model demonstrates this end to end traces from aircraft functions, to system level, and lower level software as well as the verifications covered in all of the standards
In addition to requirements to test coverage demonstration, the airborne systems standards call for bi-directional traceability between code and requirements. The source code must also be completely covered by the requirements-based tests. “Dead code” (code that is not executed by tests and does not correspond to a requirement) is not permitted. Jama Connect’s Live Traceability allows for connections to other tools in the ecosystem that engineers are using to perform these activities such as testing tools such as LDRA Tool Suite and SW configuration management tools such as Git. The LDRA tool suite is a flexible platform for producing safety, security, and mission-critical software in an accelerated, cost effective and requirements driven process. The tool suite’s open and extensible architecture integrates software life-cycle traceability, static and dynamic analysis, unit test and system-level testing on virtually any host or target platform. Finding the dead code using LDRA makes this an easy task. The figure below describes an example of a best of breed tool ecosystem facilitated by Live Traceability.
Jama Connect’s Live Traceability supports capabilities to both continuously sync data between tools in the ecosystem or display the live linked data within the UI. Organizations may require one or both use cases to support their digital transformation efforts. Tools like Syndeia from Intercax can easily make use of Jama’s Live Traceability to perform synchronizations as well as provide services to author, query, visualize, and curate open digital threads.
Live Traceability performs a crucial role when it comes to review. DO –178 calls for, and is required for the higher DAL levels, what is called “transition criteria.” Essentially this means that reviews of the traceability itself must be demonstrated. Jama’s Review Center streamlines this by displaying the up and downstream traces right in the context of the review.
Airborne systems have far more onerous governance and compliance hurdles than other industries such as automotive, finance, or medical. The standards require evidence that traceability evaluations were performed. Traceability evaluations must also be independently assessed by four successive levels of traceability assessments: 1) engineering author, 2) an independent engineering reviewer, 3) a software quality assurance auditor, and lastly, 4) a certification liaison reviewer from FAA or EASA.
At the end of the day, Airborne Systems developers must provide evidence of compliance to the certifiers. Live Traceability provides the ability, for the first time, to manage by exception the end-to-end airborne design assurance process across all engineering disciplines. The traceability model defines required data traces called for by the standards that can be compared to actual activity to generate exceptions. These exceptions are the early warning indicators of issues that most often lead to delays, cost overruns, rework, defects, and certification deficiencies.
The benefits of using Live Traceability in airborne systems development within Jama Connect and across a tool ecosystem are as follows:
Proves Airborne Systems compliance articulated in the industry standards in real time without the need to create traces after the fact and enhances the visibility that the defined process is being followed.
Provides simplified project estimates, reduces the risk of delays, cost overruns, rework, defects, and recalls with early detection of issues through exception management, and saves 40 to 110 times the cost of issues identified late in the process.
No disruption to engineering teams that continue working in their chosen best-of-breed tools with no need to change tools, fields, values, or processes.
Increase productivity and satisfaction of engineers with the confidence that they are always working on the latest version, reflective of all changes and comments.
https://www-dev.jamasoftware.com/media/2022/03/Live-Traceability-for-Airborne-Systems-Development-Blue-1.png5121024Cary Bryczek/media/jama-logo-primary.svgCary Bryczek2022-03-17 03:00:372023-01-12 16:47:32Live Traceability™ for Airborne Systems Development
Systems Engineers Career Path
Most Systems Engineers we speak with have a common perspective on their role within their organization. Systems engineering as a concept is understood and supported by leadership. And, if systems engineering best practices are followed across all engineering disciplines, leadership also acknowledges the benefits the organization can realize. However, leadership will not force change on engineering disciplines (software, hardware, electrical, risk, verification, and validation) to remove barriers to systems engineering best practice adoption. This leaves most Systems Engineers in the challenging position of possessing responsibility for achieving systems engineering benefits without the authority to ensure engineers adopt best practices.
The good news is that there is a way out of this situation. The first step to elevating your career is to realize that managing the product engineering process through data is the key and that the Systems Engineering role is the natural role to lead this. For most organizations, the product engineering process is the only process in the company that is not managed through data. No one can go to a system and see the status of all product requirements and where development, integration, risk, and testing stand at any point in time. There is no way to manage by exception. There are no alerts that requirements are not covered, test cases are missed or that hardware made a change that now impacts software. Most organizations have come to accept this state of affairs and try to manage the process through endless meetings, emails, and Slack messages.
Until the product engineering process is manageable through data, Systems Engineers will be stuck in their current trap — endlessly trying to address issues after the fact, holding unwanted meetings, and the uphill battle of trying to persuade changes in behavior. Below is a 3-step approach that Systems Engineers we work with have used to solve this organizational challenge and have thereby elevated their careers. As with any process change, it is best to do it in stages. You can start with the following steps.
Baseline current process performance
Build the business case for change to gain support
Step One | Baseline Current Traceability Performance
The first step towards moving the organization to manage the product engineering process through data is to baseline current process performance. The best place to focus the baseline effort is on traceability since it spans the entire product development process, is a data management concept that is understood, enables systems engineering benefits, and is required by industry standards. To ease the baselining effort, we’ve developed a Traceability Diagnostic that you can use to assess your current situation. The Diagnostic inventories traceable data, the systems in which they reside, and your current Traceability Score™. This is a few-hour effort and forms the basis of the business case in step two.
In this no-cost, guided process, we’ll help you:
Understand the monetary risk of your current Traceability Debt™
Uncover the quantifiable ROI of moving to Live Traceability
Develop a clear plan of action, cost, and timing to achieve Live Traceability
To Get Started With Your Free Traceability Diagnostic, CLICK HERE
Step Two | Build Business Case for Live Traceability™
Once you have established a baseline, it is now possible to build a business case for change that will resonate with leadership. Based on your baseline, the Traceability Diagnostic determines the probability of negative product outcomes (defects, delays, rework, cost overruns, etc.) and the magnitude of these events. This quantifies the risk of maintaining the status quo and doing nothing. In addition to the risk reduction potential of Live Traceability, the Diagnostic also calculates the engineering productivity gains from eliminating the need for time-consuming, manual, after-the-fact traceability efforts.
Step Three | Start with Quick Wins
Once you have secured support to move forward, it is common to be able to deliver some quick wins to the organization shortly after project kick-off. The typical place to start is the painful and time-consuming after-the-fact traceability efforts. For example, continuous syncing between requirements and software development task management in Jira or Azure DevOps can be set up quickly to automate traceability from requirements to user stories, eliminating a large source of risk and manual, after-the-fact traceability effort. Once quick wins are shown, organizational momentum increases even further and puts you on the success path to begin managing the product engineering process through data.
Clients of ours that have taken this approach have received significant recognition, been promoted into roles with greater leadership, and have increased their external visibility through speaking engagements. Live Traceability is a unique opportunity to elevate one’s career. Don’t miss the chance.
https://www-dev.jamasoftware.com/media/2022/01/2022-01-21-systems-engineer-career-path-how-to-elevate.jpg5121024Marc Osofsky/media/jama-logo-primary.svgMarc Osofsky2022-01-28 03:00:402023-01-12 16:47:41Systems Engineers Career Path – How to Elevate
Live Requirements Traceability
Achieving Live Traceability™of product requirements, as necessitated by industry standards, across siloed engineering teams and tools, is the #1 unsolved problem for most product development organizations. One of the main barriers is that each engineering discipline (systems, software, hardware, electrical, risk, verification and validation) has optimized its own process and tools. When looking at the end-to-end product development process siloed teams, tools, and data make it very challenging to trace development activity from initial requirement definition through development and testing.
As a result, requirements traceability becomes a time-consuming, error-prone, frustrating, and manual, after-the-fact process. The inability for the product development organization to continually trace ongoing development efforts and changes back to user and system requirements results in missed requirements, defects, rework, delays, audit letters, and cost overruns.
The typical approach to solve this generic process problem with software is to force every user onto a single platform and follow one common process. This works for standard business processes in HR, Sales, and Finance, but engineering disciplines across systems, software, hardware, electrical, risk, test, verification, and validation each follow different methodologies and use multiple tools including spreadsheets, desktop, and homegrown applications. Each engineering discipline has optimized their own development environment and strongly resist any attempts to change. Engineering leadership defers to each engineering discipline to define how to best do their work and is loath to dictate processes and tools that will negatively impact the performance and morale of each engineering team.
In addition to the organizational barriers to standardization, no single platform is even close to currently existing which replaces these dozens of tools. A single platform would need to cover all of the following software categories AND address all functionality in spreadsheets (Excel), scripts, desktop, and homegrown tools: Requirements Management, CAD, MBSE, DFMEA/FMEA, software task management, software code management, automated software testing, hardware bench test tools, ALM, PLM, and more. Current efforts by legacy vendors to create a common SaaS platform to span all these software categories and reach parity with best-of-breed tools is moving very slowly.
How to achieve Live Traceability™ without forcing change on engineering teams
So how does an organization achieve Live Traceability across a best-of-breed tool environment supporting disparate methodologies, terminologies, fields, and statuses? The answer is a 3-step approach:
Step One | Live Traceability Model
Define a Live Traceability model across the end-to-end product development process with relationship rules for the traceable data elements across best-of-breed tools. An automotive functional safety example is shown below. Here you can see the operational instantiation of functional safety standards requirements in a relationship model within Jama Connect®. All necessary traceable information is included with continuous syncs to best-of-breed tools within engineering teams to deliver Live Traceability.
Step Two | Adaptive Data Field Mapping
To achieve Live Traceability, integrations with best-of-breed tools (such as those shown in the example) are required. The typical integration approach standardizes field names and statuses to ensure consistency across the connected tool, but this does not achieve the dual objective of Live Traceability with no changes required in how each engineering team works. Alternately, the proven approach is to apply adaptive data field mapping to ensure no change to engineering teams’ fields and statuses which simultaneously ensures a consistent, process wide, Live Traceability model. This is achieved through robust mapping and normalization logic functionality to easily address the various approaches taken by each engineering team.
Once Live Traceability is achieved, engineering organizations can — for the first time — manage the end-to-end product development process in real time, identify exceptions to the process early, and take action to significantly reduce defects, rework, delays, and cost overruns.
LEARN MORE
https://www-dev.jamasoftware.com/media/2022/01/2022-01-14-overcome-barriers-to-requirements-traceability.jpg5121024Marc Osofsky/media/jama-logo-primary.svgMarc Osofsky2022-01-14 03:00:212023-01-12 16:47:44How to Overcome Organizational Barriers to Live Requirements Traceability
In this blog post, experts from Cadence, OpsHub, and Jama Software talk about enabling digital transformation in the hardware and semiconductor industries.
The relentless pace of innovation, rapidly changing markets, and increasing product complexity are creating intense pressures on companies in the semiconductor and hardware space. Some of the biggest challenges relate to scaling effectively and efficiently within the context of digital transformations.
Organizations in all sectors are looking to support faster release cycles and accelerate innovation. Siloed and legacy tool chains create a major hurdle in accomplishing these goals.
Watch the webinar or read the recording to learn more about:
Rich collaboration
Complete traceability
Full transparency among all stakeholders
Faster releases
Improved quality and productivity
Below is an abbreviated transcript and a recording of our webinar.
asd
Jama Connect: the Leading Platform for Requirements
Matt Graham: Thanks everybody for joining. So today, before we get into the agenda just to introduce the three products that there are three subject matter experts about. First of all, something near and dear to my heart, the Cadence vManager, verification management platform which is a scalable, reliable and very feature rich verification planning and management solution from Cadence. That sits on top of a number of our verification and provides a sort of roll up capability. And we’ll describe it in a little more detail in a couple of slides. On the OpsHub opposite side, we’ll be looking at the OpsHub integration manager that enables enterprises to integrate their best of breed tools together that are best suited for the various teams and their various roles and connect those two together for integration and collaboration. And then Jama Connect, which is the leading platform for requirements, risk and test management to help provide that sort of end-to-end compliance solution.
Our agenda today. First we’ll look at some of the challenges of the semiconductor and hardware development ecosystem. This is obviously a very fast paced, highly competitive type of environment and there’s a lot of specific challenges that the integration of the tools I just mentioned can help address and solve. We’ll look at how engineers in this space can scale effectively and efficiently utilizing some of these, the tools to address some of the ongoing transformations in that space. And then specific to semiconductor domain, bridging the gap in what has historically been a very siloed development process. And bringing together for efficiency, quality and reliability all of the various tools that I mentioned and giving it a really nice integrated development and verification environment. We’ll then have a specific use case and demo showing how the three tools work in concert and then look at some key takeaways. And as Marie mentioned, some Q and A.
Standards for Requirements such as ISO 26262
Specifically to the semiconductor and hardware ecosystem, there are a developing set of challenges. And of course they’ve always been challenges in this area. First pass design success is critical for hardware development. Just because the tooling costs are so great. We don’t want to have to respurn hardware. It’s not like just releasing more software. It is it requires expense. But that has been the way of hardware development for some time. In the last several years we’ve seen a need creeping into that environment for even stricter compliance, particularly around mission critical domain such as aero and defense, automotive especially as self-driving and autonomous vehicles come in. And adherence to standards like ISO 26262 presents another layer of requirements and need for management and collaboration on top of an already strict set of sort of design parameters.
As I mentioned, this development environment tends to be very siloed in its nature because it is so specialist. You have specialist designers, specialists verification engineers to test the designs, specialists post silicon, specialists layout engineers and so on and so forth. And all of those silos, well somewhat required of the specialty of each of those tasks tends to hinder collaboration, compromise quality and just impact efficiency and velocity overall. In an area where efficiency and quality is critical. We can’t have bugs in semiconductors going to automotive and we need to be able to turn those new cell phones, those new mobile devices as quickly as possible. So turnaround time is just getting compressed and the requirement for quality is increasing at the same time.
All of that sort of siloed nature of the specialties as well as the need for velocity and quality really ends up in poor traceability of results in terms of compliance and quality issues creeping in. Especially when it comes to doing things like audits for ISO and other similar standards that are becoming the requirement across again aero and defense type applications, automotive type applications and even down into the sort of consumer device applications. And really traceability is a watch word now in the ecosystem of hardware and semiconductor development.
So how does the offering from Cadence, vManager fit into and help provide a solution to those challenges that I just mentioned? Well, for a number of years now, in fact, vManager has been around for about 15 years and in that entire time it’s had the key capability of the verification plan. And the verification plan really exists to provide traceability between what is being executed during the testing or verification of your semiconductor or hardware design. And what were the goals of that or the requirements of that testing or verification project. Things like testing interfaces, both internal and external to the semiconductor, testing compliance with standards like ethernet and USB, such as that, things like that. As well as the internal requirements of the device, it must route packets this fast. It must answer phone calls in this manner or whatever it might be.
And the verification plan in vManager really allows the user to enter those requirements and then connect them to the real results that are occurring. We ran these tests, these tests were associated with a given requirement. Those tests passed therefore the requirement is satisfied. And so the V plan becomes a very natural place. And in fact the appropriate place to connect the rest of the ecosystem via OpsHub, two tool requirements coming from Jama Connect so that we can have traceability across the software development, the hardware development, whatever. The mechanical development et cetera ecosystems. And the vManager and the verification plan is really where that hardware verification, that hardware and semiconductor development information enters that ecosystem through the conduit of the verification plan. So let’s look a little bit more on, well what exactly is in that verification plan that vManager provides.
Enabling Digital Transformation: Static Documents Cause Challenges
And the V plan is really what we call, what we refer to in our vManager sort of pitch if you will as an executable verification specification or an executable verification contract. And what that means is that there’s data incoming to that during the creation, the authoring of that verification plan. Not only through connectivity to tools like Jama but also from say static documents like standards specifications, ethernet that I mentioned before, USB those are standard protocols that have very lengthy standards documents and needs to be a way to import, kind of gather the data from that and put it in the verification plan. Another input to the verification plan is other verification plans. So if you think about a system on a chip that is not a single piece of intellectual property, it’s built up of many, many different pieces, a USB piece, a central processing piece, a memory management piece and so on.
And each of those pieces can have their own verification plans for the verification at that sort of lower block level as well as then can sort of conglomerating or aggregating those verification plans into a single sort of system on a chip verification plan. And the vManager, V plan allows that through sort of parameterization and instantiation and really flexible set of sort of reuse capabilities for verification lands. And then of course just engineers authoring their verification plan. Literally writing, typing in here’s a specific requirement et cetera. And then we have the component of mapping those requirements to items that exist in the actual testing environment. Things like we have a test, did it pass or fail? What requirement is that test related to? So there’s mapping the test to a particular requirement and then did that test pass or fail. Those of you familiar with hardware verification know that tests passing and failing is not the only statistic or metric that we track.
There’s other metrics and statistics such as code coverage, functional coverage, assertion coverage, software coverage, all tracking what scenarios and what stimulus were driven to the specific device under test. And what was the reaction of the device under test? And then what percentage of the device has been exercised during that test? It is all basically statistics gathering from the testing effort. All that data can be mapped into the verification plan, directed to the specific requirement or multiple requirements that it may satisfy. And of course, this gives us the ability to not only specify a requirement, but then capture whether that requirement was met. Was it satisfied? And this is the place where I’ll hand over to Jeremy now to talk about what those requirements in those higher level requirements or system level requirements in the general world and how they’re going to connect into this hardware verification, hardware development world.
https://www-dev.jamasoftware.com/media/2021/10/WB-2021-10-20_Enabling-Digital-Transformation-OpsHub_Social-Image.png5121024Jama Software/media/jama-logo-primary.svgJama Software2021-10-19 03:00:572023-01-19 12:50:19Enabling Digital Transformation in the Semiconductor and Hardware Space
Design Controls have been an FDA Quality System Regulation since 1997. Having worked on developing products in the regulated medical device industry for over 35 years, I have compiled a list of the five key takeaways for implementing design controls and achieving success in commercializing medical devices:
Design Controls not only help achieve regulatory compliance, they help develop better products
Design Inputs lay the foundation for product development, building a good foundation
Don’t underestimate the power of Bidirectional Traceability
Know the difference between Verification and Validation
Risk Management is a vital part of Design Controls
#1 – Design Controls not only help achieve regulatory compliance, they help develop better products
Many companies think that design controls are a burden to development organizations imposed by the FDA, and it’s the price to pay for playing in the medical device field. However, what is often overlooked is that design controls only define the basic minimum requirements necessary to develop a product that can…
…meet the needs of the user.
…be designed to be safe and effective.
…be reliably manufactured.
…be verified and validated.
…maintained and updated throughout the product lifecycle.
These are all things that any development organization should do to successfully deliver products to market. I like to say that if you are doing the right things in product development, compliance comes for free!
#2 Design Inputs lay the foundation for product development, building a good foundation
The FDA defines design inputs as the physical and performance requirements of a device
that are used as a basis for device design. To generate adequate design inputs, the foundation upon which product development is built, the user needs must first be well understood. These needs, ideally written with the voice of the user, must then be translated into design requirements. In contrast to the user needs, these design requirements should be written using the voice of the engineer, and as such should be measurable and testable. Furthermore, design requirements should be traceable to a specific user need, risk control, or standard that necessitates the existence of said design requirement.
Research has shown that, on average, companies that are successful at developing products spend about 25% of the product development time on the generation of user needs and the subsequent design requirements. The return on this investment of time and resources reduces the need for rework and redesign, and ultimately leads to higher customer satisfaction. Failing to make the investment ensures that design inputs are complete and correct is analogous to building a house on quicksand, where the flaws in the foundation can cause issues throughout the construction and subsequent (likely short) lifetime of the house. Issues with requirements will impact development, verification, validation, and user acceptance of the product, so spending the time to get requirements right will be well worth the effort.
#3 Don’t underestimate the power of Bidirectional Traceability
In an audit, the trace matrix should be valued as a friend! Having and maintaining bi-directional traceability throughout the product lifecycle provides a number of benefits:
Effecting project tracking
Thorough change impact analysis
Ease of making future changes
Re-use of elements of the design
More effective issue resolution
To derive these benefits, the relationship between the following entities should be established:
User Needs and Design Requirements
User Needs and Validation
Design Requirements and lower-level requirements
Design Requirements and Verification
Lower-level requirements and verification
Lower-level requirements and Design Outputs
Risk Controls and Design Requirements
In creating a trace matrix that has views to show all the bi-directional relationships of each of the elements described above can help answer most questions from an auditor. With this level of traceability, I can trace from a user need all the way through implementation and test.
#4 Know the difference between Verification and Validation
The terms “Verification” and “Validation” often get combined and abbreviated to V&V; however, these activities are vastly different.
Verification is confirmation by examination and provision of objective evidence that specified requirements have been fulfilled. It is design-centric and answers the question “Did I build the product right?” Verification also entails gathering objective evidence that the design behaves as intended through the use of observation (visual inspection), measurement (values and tolerances), testing (function) or analysis (reviews).
Validation is confirmation by examination and provision of objective evidence that the particular requirements for a specific intended use can be consistently fulfilled. Unlike Verification, this is a user-centric term, and answers the questions “Did I build the right product?” and “For whom is this the right product?” Validation entails gathering objective evidence that the design satisfies the user needs through the use of Usability Studies/Human Factors Studies, Clinical Evaluation/Clinical Studies, Customer Surveys, and through Analysis of Verification Data.
Knowing the difference between Verification and Validation is of quintessential importance for ensuring customer satisfaction and regulatory acceptance of the product.
#5 Risk Management is a vital part of Design Controls
The elements of design controls are Planning, Design Inputs, Design Outputs, Design Reviews, Design Verification, Design Validation, Design Changes and the Design History File. So, what happened to Risk Management? Risk is mentioned in Design Control Regulation (QSR 820.30) all of one time, under Design Validation. The statement simply reads “Design validation shall include software validation and risk analysis, where appropriate.”
Fortunately, the FDA Design Control Guidance elaborates on requirements for risk management. The guidance includes this paragraph:
Risk management begins with the development of the design input requirements. As the design evolves, new risks may become evident. To systematically identify and, when necessary, reduce these risks, the risk management process is integrated into the design
process. In this way, unacceptable risks can be identified and managed earlier in the
design process when changes are easier to make and less costly.
The takeaway from this is that although risk management is just cursively mentioned in the QSR Design Control regulation, the intent of the regulation is that Risk Management be practiced starting from the point where design inputs are known and practiced throughout the product life cycle. You cannot be compliant to the design control regulation without having an adequate risk management file.
Conclusion:
Design Control regulations have been around since 1997, but many manufacturers still have problems complying with design controls. Focusing on the best practices outlined above will derive the most benefit from implementing Design Controls, will lead to a more predictable development cycle, and ultimately result in higher-quality products that can be enhanced and maintained throughout their lifecycle.
https://www-dev.jamasoftware.com/media/2021/09/2021-10-07-five-key-design-control-pracitces_1024x512.jpg5121024Mercedes Massana/media/jama-logo-primary.svgMercedes Massana2021-10-07 03:00:322023-01-12 16:48:01Five Key Design Control Practices that Improve Compliance and Help Develop Better Products
Editor’s Note: This posts on lessons learned around medical device development during COVID 19 was originally published here by MedTech Intelligence and written by Josh Turpen, Jama Software’s Chief Product Officer.
In the fall, I wrote about how the medical technology industry has struggled to keep pace with other, similar industries. In the piece, I discuss how important it is for engineers designing those products to move gradually and carefully, even when under immense pressure, to reduce time-to-market. Now, a year on from the stay-at-home order issuance across the United States, it’s time to take stock on what temporary measures need to be made permanent to grow as an industry.
As we move forward into a post-pandemic world, it is important that companies are explicit with the lessons that they have learned from this past year. Executive staff, rightfully so, have been focused on keeping things going. Now the focus should shift to “how do we exit the pandemic in a better place than when we entered?” This is where it becomes important to create an open dialogue about what was successful and what could have been done better. This will assist in making those temporary adjustments a permanent fixture in medical device production.
Before we look towards a post-pandemic world, though, we need to evaluate where things went wrong and how to better address them moving forward.
What Have We Learned?
If COVID-19 taught us anything it is that we need to be more efficient at speed-to-market when creating products, especially when it comes to medical product production. Additionally, gone are the days of person-to-person-only collaboration. Organizations now have the capabilities for a hybrid environment consisting of remote and in-person teams.
The complexities of product development within health and life sciences should not be a surprise. What is more alarming is that, as the complexity of medical devices increases, we still have many engineering teams that are relying on decades-old technology such as Word documents and spreadsheets to manage requirements, risk assessment and testing. These legacy tools have a place in most of the professional world, however, they are not adequate for development teams who need to achieve alignment with massive amounts of data, regulations and standards to ensure device safety and quality.
As these device management teams face immense pressure to innovate while collaborating across software, hardware and quality teams, it is essential that their work is tracked and seamless to meet the increasing pace of market demand. That’s why we have seen traceability evolve to account for the complex, ever-changing nature of requirements, test and risk management. For a growing company to be successful, everything must be able to work simultaneously, at scale and across teams. Legacy tools do not provide the agile capabilities that modern traceability does.
It hasn’t been easy for engineering teams to adjust to their fully remote workplace. Even organizations that offered a hybrid working model previously are struggling to ensure their teams are aligned to meet delivery dates and project deadlines. The organizations that will have a distinct advantage over others are those focused on collaboration and context within their teams. These teams will be best set up to quickly build high-quality products, further ensuring better patient outcomes.
As mentioned previously, the best course of action following this difficult year is to ensure company leaders are shifting their focus towards figuring out how to leave their companies in a better place following the pandemic, versus where they were when they entered. Based on my experiences as the chief product officer for a leading requirements, risk, and test management platform, I have noticed a few key ways that executives in the medtech industry can better prepare themselves moving forward.
1. Adaptability
In general, companies that have adaptability embedded in their DNA have already handled the peaks and valleys of the pandemic far better than those that remained rigid in their approach. Looking ahead, it will be immensely important to evaluate your process assumptions and determine how resilient you are to change.
Without a malleable business model, a company will constantly be scrambling any time it hits a road bump. However, with the right digital tools at your disposal, your company will be able to adapt quickly and effortlessly, allowing your employees and customers to remain calm in times of crisis.
2. Alignment
While companies in all industries adapt their business models to prepare for the new normal, innovative tech companies are transforming the devices and systems they build, and the technology and process they use to build them. Newer technologies in the medical field, like robotics nanotechnology and wearable health tech devices, bring added complexities for medical device companies. There is an additional risk for patients and consumers, which makes having the right product development solution in place even more important.
Medical device companies that embrace a proactive approach to quality will ultimately find fewer issues with their products, improve customer satisfaction, and stay competitive for the foreseeable future. To do this quickly and efficiently, though, teams must be aligned throughout the entire product development lifecycle. By leveraging an integrated platform for requirements management, teams can stay interconnected and deliver high-quality products that improve patient outcomes.
Benjamin Franklin once said, “by failing to prepare, you are preparing to fail.” As we look ahead into 2021, I believe it is unlikely we will see large regulatory changes in the medtech industry. However, over the next decade, a great increase in regulations for medical device development is definitely looming. So what can a company do in the meantime? Tighten up your risk management practices, before it’s too late.
The fact is, the medtech industry will always grow at a rapid pace, and regulations will follow. To avoid being left behind by events such as, finding regulatory issues in late-stage device development, and then having to implement confronting costly and time-consuming rework, your teams must align and future-proof the entire development lifecycle.
Future-proofing is the process of using digital tools to capture knowledge and ease accessibility for future employees, independent of the product development lifecycle stage. Employing future-proofing strategies helps company leaders and decision-makers ensure symbiosis throughout the entire process. Future-proofing is key in the age of digital transformation, as it helps address common concerns about collaborative environments, team efficiencies, and product integrations. A software that is up to this task will help you do this in three ways:
Comprehensively enables collaboration by giving users a single source of truth to track decisions, questions, and problems
Increase team efficiency by capturing knowledge within that single source—often without even realizing it—through feedback and team communication.
Seamlessly integrates digital tools that track development and with other information gathering and tracking solutions, knowledge is captured at multiple levels, streamlining future projects.
4. Harmony
Finally, to be successful, there will need to be harmonization on the development methodology across different devices, reducing the need to work off of different documents. Each product in development has its own particular set of customers, stakeholders and internal team members associated with it. Therefore, it is important that these individuals can be accurately connected to the items for which they are responsible. Enter traceability.
Traceability is all about relationships. To make informed choices, product development professionals need tools that allow them to see changes in real-time, within the team’s structure, and throughout the system where their product exists. Modern traceability makes it possible to manage and respond to change with confidence in a systematic and auditable way. When done correctly, traceability can be used as a key tool to allow for harmonious decision-making. Without it, accountability is incomplete and past decisions can’t easily be seen, learned from or built upon.
Overall, COVID-19 has been industry-defining as companies were made to quickly shift how their teams collaborated, now forced to have a remote workforce. As we see the light at the end of the tunnel it’s time to look towards the future of medical device development. Let’s take all that we’ve learned from this past year and use it to ensure that we’re putting out high-quality products, quickly and accurately.
https://www-dev.jamasoftware.com/media/2021/05/2021-06-01-lessons-learned-med-device-covid.jpg5121024Josh Turpen/media/jama-logo-primary.svgJosh Turpen2021-06-01 03:00:132023-01-12 16:49:07Lessons Learned: Medical Device Development Through COVID-19 and Beyond
Requirements Traceability – What are you missing?
For systems engineers, business analysts, and product owners,requirements traceability (the ability to trace requirements to downstream development, test, verification, validation, and risk activities) is an unquestioned good and an unquestioned need. Traceability is requiredto demonstrate compliance to relevant standards in industries such as medical device, automotive, semiconductor, aerospace, and financial services.In addition to compliance requirements, traceability is quite helpful to assess the impact of change required on all relevant requirements and related downstream activities. But the largest potential value is missed by many organizations.
After-the fact use cases
The two main use cases for traceability noted above are both reactivetorequests: the need to demonstrate standards compliance to third parties and the need to analyze the impact of a change request.Bothuse cases view requirements as static and passive. Requirements are documented and links created to downstream artifacts in software, hardware, and electrical development test and risk assessment —which are stored in a system. The system thenwaits until a request comes in from outside to document that a process has been followed or to identify which elements are impacted by a change. Both use cases reflect an after-the-fact mindset that limits the value that can be achieved from the effort put into establishing traceability.
Analogies to other business-critical functions
To view somethingwe think we know well in a new light, it is often helpful to place it in a different context and look at it from a fresh perspective. So, let’s give it a try andcompare traceability in the product development process to traceability in the new customer acquisition process.
For engineers, these processes may at first appear to be too disparate for an apt analogy, but at a fundamental level, they are quite similar. Both start with a documented value (requirement vs. opportunity) that must transition through multiple phases and involve many other functions to reach the desired outcome (release vs. win) — and all sorts of things can go wrong along the way leading to delays, costs incurred, and failure.
The aspect I want to focus on is howthese two processes are managed. In the sales process, the element of value (the opportunity) is living— actively measured, analyzed, and tracked for exceptions on a daily basis. The key process metrics are defined with ranges for acceptable performance. Current process performance is automatically calculated based on the movement through stages of all opportunities. Alerts are raised for opportunities stuck in a process stage too long (relative to average dwell times) and predictions are made about future period performance based on the opportunities in the system.
In contrast, for most product development organizations, requirement traceability is static and in after-the-fact analysis and not living— in the way opportunities are traced in sales as described above. To make requirement traceability living (like a sales opportunity) traceability would require software-enabled best practices in the following areas:
Process metrics must be defined
Actual performance against process metrics must be captured
Once standard metric performance is defined, current performance must be compared to the standard
Exceptions need to be defined
Alerts need to be set up to notify when exceptions occur
Learnings need to be incorporated into process improvement
Once these steps are taken to improve requirements traceability, then requirements become living, not static, and performance improvement is possible: the risk of negative product outcomes isreduced, and process performanceis improved; the product development process can then be data-driven, measured, and managed like all other business-critical processes. Without measurement, there is no way to benchmark performance against other organizations.There is no way to learn, no way to know, and no way to improve.
Jama Connect’s Requirements Management Enables Live Traceability™ Across Your Development Process
Bridge engineering siloes across development, test, and risk activities. Provide end-to-end compliance, risk mitigation, and process improvement with our intuitive, award-winning requirements management platform. Learn more!
Better to stay in the dark?
There may be some that would prefer to keep the product development process shrouded in mystery and avoid data-driven analysis, measurement, and process performance improvement. There used to be chief revenue officers (CROs) that felt the same way.It is extremely hard to find any current CROs with that mindset.Those that can lead through data and drive performance improvements gain the support of leadership and elevate their careers.The same opportunity is now on the table for product leadership to turn requirements traceability into living requirements in orderto reduce the risk of negative product outcomes and improve the performance of the end-to-end product development process.
To learn more on the topic of requirements traceability, we’ve curated some of our best resources for you here.
https://www-dev.jamasoftware.com/media/2021/01/2021-1-8-RequirmentsTraceability-MarcO.jpg5121024Marc Osofsky/media/jama-logo-primary.svgMarc Osofsky2021-01-08 03:00:442023-01-12 16:49:35Requirements Traceability – What are you missing?
Editor’s Note: This post about how traceability improves collaboration and decision making was originally published here on DevOps.com on September 23rd, 2020, and was written by Josh Turpen, Jama Software’s Chief Product Officer.
Jama Connect® creates Live Traceability™ through siloed development, test, and risk activities. Provide end-to-end compliance, risk mitigation, and process improvement with our intuitive, award-winning platform.
Minimize the risk of delays, defects, cost overruns, and the manual effort created by fragmented development processes and legacy solutions. Learn more!
New software is being developed at an incredible pace to help make our lives easier. This doesn’t change the fact that humans are still held accountable for product development decisions, whether these are made with or without advanced analysis tools. To make informed choices, product development professionals need tools that allow them to see comprehensible information in real-time as change is happening, both within the team’s structure and throughout the system in which their product exists.
Modern traceability makes it possible to both manage and respond to change in a systematic, auditable and confidence-enhancing way. Below, we will discuss three ways traceability has evolved to support key decision-makers in a number of industries.
Modern traceability captures when you make a decision
Decisions often have varying levels of durability. Sometimes, when you make a decision, you know then and there it’s final. Other times, you make what seems to be a minor choice and you end up dealing with the repercussions for years to come. With this level of uncertainty, it is essential to have mechanisms that allow you to see when decisions are made. As I discussed in a previous article, “5 Ways Traceability is Changing to Bolster the Remote Workforce,” this process can be compared to a map. By leading a team through every step of their processes, modern traceability helps product developers reach their goals without any surprises.
Often, products are expected to be maintained for years. This is significantly more challenging when you can’t properly track where a ruling originated or a change was made. While the team may move quickly in the development process, the record should always live on to provide future context where it’s needed.
Modern traceability provides people the context of what they’re working on as they go, not after the fact
Rather than rely on sharing often lengthy and disparate documents or running time-consuming general meetings, traceability allows teams to streamline their collaboration. Mapping out work items, including owners and contributors, gives people a reason to care and to trace those items carefully. It helps everyone know why they’re there, what they are discussing and how to address it.
Many smaller companies are fortunate to get by using Word documents and other legacy tools for their traceability measures. However, as these companies grow, so do the complexities. That’s why traceability has been evolving to account for the multi-dimensional nature of requirement, test and risk management. For a company that is seeing major growth to be truly successful, all related variables must work together continuously, at scale and across teams. Legacy tools simply do not provide the agile capabilities that modern traceability does.
Traceability captures and tracks past decisions and allows users to access them
Traceability is all about relationships. Each product in development has its own particular set of customers, stakeholders and internal team members associated with it. Therefore, traceability is only possible if these individuals can be accurately connected to the items for which they are responsible.
Knowing who made a decision and what information they accessed is equally as important as the information itself. If you can’t quickly piece that together, your traceability is incomplete. The responsible thing to do is to ease the process by keeping useful records. It doesn’t need to be forced behavior if it’s captured along the way as a byproduct of doing your job.
Overall, accountability is incomplete and past decisions can’t easily be seen, learned from or built upon without robust, modern traceability tools. It’s much harder to legitimately hold someone accountable when they’re working in the dark. However, when done correctly, traceability can be used as a key tool to support genuine liability and allow for a streamlined process of complex decision-making.
Download our eBook to learn how optimize product development with strategic team collaboration.