A baseline is defined as a single set of data that has been captured for purposes of measuring improvement.
A baseline is a set of captured data to measure improvement. A baseline can be a benchmark, but a benchmark can only be a baseline once. A baseline is generally is generally captured once during a cycle or phase, and future benchmarks are compared to a single baseline.
A methodology is a defined set of methods collected to accomplish a goal.
In many organizations, the term methodology is commonly used when describing the ways actions are done in the company. These actions are typically executed with certain methods or ways of doing things. Over time, organizations learn from their mistakes and modify these methods, formalize them, and call them their methodology. These collections of methods are often revisited and improved over time.
A process, in terms of software methodology, is a set of related tasks which are compiled to a accomplish a goal.
Within a methodology, each method defined generally requires a set of tasks that must be completed. These set tasks are called processes. Both a methodology and it’s encompassing processes are created to accomplish a common goal for the organization.
A procedure is a set of actions, operations, or methods which are executed the same way each time in order to obtain the same result.
Procedures exist within the methodology to ensure the processes are executed in a consistent manner. These set of steps are defined to complete several tasks to complete certain processes which make up a methodology.
A test framework is a set of concepts, methodologies and tools to support the software testing effort.
Test frameworks provide a mechanism for consistent testing procedures around software testing. These repeatable techniques ensure the software testing practices yield reliable results as the organizations matures.
Keyword-driven testing is a test methodology which employs action-words to drive events in a test case or script.
As organizations become more test savvy, a methodology known as keyword-driven testing provides an effective mechanism to organize the test scripts into logical components that can be used repeatedly. These components typically consist of an object, an action, and supporting data if required. The methodology usually requires a longer ramp-up period since planning and implementation of the components take time to build and organize. This initial investment pays off since there is an substantial decrease in technical skill requirement to build keyword-driven tests once a framework is in place.
Verification and Validation
Two terms that are commonly used in the software testing world are verification and validation.
Verification is a quality process which ensures a product complies with standards and regulations. Validation on the other hand, ensures the product adheres to established requirements. A quote from Barry Boehm makes this clear; Verification ensures we are producing the product right and Validation ensures we are producing the right product.