Open access peer-reviewed chapter - ONLINE FIRST

Qualitative Analysis of Different CRM Evaluation Models

By Christoph Weiss, Johannes Keckeis and Manfred Kofler

Submitted: May 13th 2019Reviewed: September 17th 2019Published: November 26th 2019

DOI: 10.5772/intechopen.89776

Downloaded: 17

Abstract

Customer relationship management (CRM) systems help companies to manage their business processes. Specially for sales, campaigns, contact management, etc. The simpler and more efficient the business processes are executed, the more profitable these companies can be. Therefore, the process of selecting and evaluating a CRM system is an important success factor for each company in every industry and in every company size. The qualitative analysis of CRM evaluation models examines the necessary phases and activities for selecting a new CRM system. It is important to go through the relevant phases in the selection in order to be able to make a decision in a structured manner.

Keywords

  • analyze
  • business management
  • CRM
  • customer relationship management
  • criteria
  • decision
  • evaluation
  • evaluation models
  • normalize
  • market information
  • model
  • negotiation
  • project
  • requirements
  • selection
  • solution
  • system

1. Introduction

A customer relationship management (CRM) system is a business management software [1]. CRM software solutions usually include relevant modules for managing and executing business processes in a company such as operational CRM processes (marketing processes, sales processes, or service processes), analytical CRM processes (target group analysis, cross-selling analysis, or customer risk analysis), comprehensive processes (customer value analysis, customer segmentation, or customer characterization), or strategic processes (strategic analysis, strategic conception, or strategic controlling) [2]. A CRM system helps various parts of sales and marketing departments of an organization to organize and share data and knowledge, reduce costs, and improve the management of their business processes [3].

Various architectures of CRM systems exist on the market: proprietary CRM systems, modules as a part of ERP systems, and original equipment manufacturer (OEM) systems in enterprise system landscapes. CRM vendors and implementation partners offer similar bundles of functionalities in their software-products: a set of application modules that fit together. Each module includes a variety of functions [3].

There are different approaches for evaluating and implementing a CRM system. Thus, software evaluation is not a simple technical activity; it is a decision process including subjectivity and uncertainty with no possibility of arbitrary reduction [4]. As listed in the Appendix, several authors developed evaluation models with different methods between 1998 and 2017. These models are structured in different phase sequences and are used as a base for this paper.

2. Methodology

The methodology approach is structured in two phases:

  1. Literature analysis

  2. Qualitative content analysis (word analysis)

In the first phase (literature analysis), different models in evaluating CRM systems are identified and used as a basis to develop a new CRM evaluation model. Twenty-one different CRM evaluation models have been identified (see Appendix: Table 16).

In the second phase, all identified papers are processed via a qualitative content analysis (word analysis). In this analysis, sources, levels, phases, activities, and tasks are qualitatively coded. Identical or similar phrases are combined and derived [5] as shown in Table 1.

SourceLevelPhaseOriginal wordingActivity
Q029E01001E01RequirementsDefining requirements: first requirements and then softwareDefine requirements
Q253E01002E01RequirementsDefinition of requirementDefine requirements
Q139E02012E01RequirementsDevelop CRM request matrixDefine requirements

Table 1.

Example of word analysis.

Within the word analysis, terms are summarized as shown in the following examples [6]:

  • “analyze” (analyze, check, identify, verify, …)

  • “define” (appoint, define, form, setup, organize, …)

2.1 Different ways of sequencing

Based on the word analysis, the sequences of phases and activities are determined. Three different calculation types are used to determine the sequences:

  1. The phases or activities were normalized in each evaluation model, and an average value was calculated.

  2. Average value is given by the sum of the multiplication of nominations per phase/activity number, and the frequency of the mentions in this phase/activity is divided by the amount of nominations per phase/activities.

  3. The mean is determined from the occurrence of the identified first and last phase or activities of the analyzed models.

Phase/activityNomination in phase/activityABCD

∑: number of entries in the 21 papers.

A: average of phase/activity numbers (phases including nominations).

B: sum of (amount of nominations per phase * phase number)/amount of nominations per phase/activity.

C: normalized phase/activity (see normalization formula in the appendix: Table 17).

D: ranking (column C).

3. Analysis

The number of phases within the different CRM evaluation models varies between two and eight phases. In this analysis, only phases which are listed in minimum three of the 21 papers mentioned before were considered. On average 4,48 phases are present. Table 2 shows the considered phases.

The following terms are mentioned in the papers on the one hand as an activity in a selection phase and on the other hand as a phase: definition of requirements, longlist, market information, presentation, negotiation and contract, and decision.

Each phase is structured with different activities. In this analysis, only activities which are listed at least two times in the phases mentioned before are considered. In the 21 papers, these activities are called sub-phases or detail descriptions. Further identified and analyzed activities will be added after each phase.

3.1 P1 condition phase

The main activity in the first phase is clarification and definition of the strategy. This concerns the corporate strategy as well as the IT strategy and CRM strategy (Table 3).

PhaseNomination in phaseABCD
(Business)process analysis1, 432.50002.00000.14293
Analyze1, 2, 3, 794.00002.44440.29745
Conditions131.00001.00000.00001
Decision3, 4, 5, 875.50005.28571.000013
Evaluation2, 433.00003.33330.66678
Longlist2, 342.50002.50000.35717
Market information1, 2, 3, 4, 563.00002.66670.32626
Negotiation and contract3, 5, 735.00005.00000.952412
Presentation3, 4, 7105.00004.20000.688810
Project initialization1, 251.50001.20000.02862
Requirement definition1, 2, 3112.00001.81820.25764
Selection1, 2, 3, 4, 5, 6, 8224.50003.31820.66839
Shortlist3, 4, 544.00004.00000.766711

Table 2.

Considered phases.

ActivitiesNomination in phaseABCD
Define strategy121.00001.00000.00001

Table 3.

Activities in the condition phase.

3.1.1 Other activities

It is important to differentiate the CRM evaluation project from other projects in the company and to focus on the selection and implementation of CRM processes with a new CRM system. Furthermore, basic requirements are clarified.

3.2 P2 project initialization phase

In Table 4, four activities are identified. At the beginning of the project initiation, a project manager is appointed by the management. The project manager defines the project and elaborates the project assignment in detail. One focus is detailing the goals, which have been defined by the management in the condition phase. Following this, the project will be launched.

ActivitiesNomination in phaseABCD
Define a project1, 432.50003.00000.40004
Define goals1, 322.00002.00000.20003
Define project manager121.00001.00000.00001
Start project1, 221.50001.50000.07142

Table 4.

Activities in the project initialization phase.

3.2.1 Other activities

A project sponsor is set by the management to give the project the necessary importance in the company. The project is justified by the project manager who defines the project team. The detailed project scope is agreed with the project team and the project client. Another activity includes conducting a preliminary study on the feasibility of the CRM project. A kickoff is prepared and carried out. A detailed risk analysis is done and a risk management for the project is established. On the one hand the project budget is defined and on the other hand a exact timetable is defined and formulated.

3.3 P3 (business) process analysis phase

In the process analysis phase, all necessary business processes are defined. This phase includes identification, documentation, and evaluation of all CRM processes. In further step criteria for the evaluation of CRM systems, CRM providers and CRM business processes are defined (Table 5).

ActivitiesNomination in phaseABCD
Develop processes1, 422.50002.50000.21432
Set criteria1, 221.50001.50000.50001

Table 5.

Activities in the project initialization phase.

3.3.1 Other activities

In business process analysis, processes can be further developed and modeled.

3.4 P4 requirement definition phase

In the requirement definition phase, the requirements (business and technical view) are determined, analyzed, defined, and prioritized. Specifications are developed for detailed requirements. These requirements affect the CRM processes, CRM systems, and CRM providers. The detailed requirements are listed in a requirement catalog, which is the basis for the specifications (Table 6).

ActivitiesNomination in phaseABCD
Analyze requirements121.00001.00000.00001
Create requirement catalog1, 2, 533.00002.66670.44445
Create specifications4, 524.50004.50000.71436
Define requirements1, 2, 3172.00001.52940.18634
Determine requirements1, 241.50001.25000.00001
Prioritize requirements121.00001.00000.00001
Set criteria3, 433.50003.33330.91677

Table 6.

Activities in the requirement definition phase.

3.4.1 Other activities

Selection criteria are weighted, and the decision criteria are prioritized. CRM processes are developed. Target processes for the processing of CRM activities are defined.

3.5 P5 analysis phase

An actual analysis of all relevant CRM business processes must be carried and worked out. This includes all needs for functions and processes of the CRM systems. Furthermore, the future (CRM) processes will be developed, and the selection criteria will be evaluated (Table 7).

ActivitiesNomination in phaseABCD
Analysis needs222.00002.00000.25002
Evaluate criteria2, 342.50002.25000.41674
Capture software222.00002.00000.33303
Develop processes2, 322.50002.50000.41674
Perform an actual analysis1, 2, 342.00001.75000.12141
Perform analysis2, 724.00004.50000.67866

Table 7.

Activities in the analysis phase.

3.5.1 Other activities

The following points are defined:

  • All necessary (CRM) processes evaluation criteria

  • Quantity structure such as number of offers, customers, etc.

  • IT infrastructure

  • CRM improvement potentials

3.6 P6 market information phase

Within the market information phase, not only CRM systems but also CRM vendors and CRM implementation partners are determined and structured in an adequate market overview (Table 8).

ActivitiesNomination in phaseABCD
Conduct market research3, 4, 534.00004.00000.48573
Market overview1, 221.50001.50000.25002
Search providers121.00001.00000.00001

Table 8.

Activities in the market information phase.

3.6.1 Other activities

In P6, a first longlist is created. This is done based on the evaluation of the market data. Detailed information is collected from the providers in the form of a specification.

3.7 P7 longlist phase

3.7.1 Other activities

A longlist of CRM systems and CRM provider (vendor and implementation partner) is created (Table 9). All possible CRM systems and CRM providers are listed. Based on the defined criteria, the CRM systems and CRM providers are evaluated.

ActivitiesNomination in phaseABCD
Create longlist2, 332.50002.33330.38101

Table 9.

Activities in the longlist phase.

3.8 P8 evaluation phase

3.8.1 Other activities

In addition to the (CRM) business processes (Table 10), the IT infrastructure is also evaluated.

ActivitiesNomination in phaseABCD
Evaluate criteria2, 423.00003.00000.62501

Table 10.

Activities in the evaluation phase.

3.9 P9 selection phase

The selection can be done over 1-n stages (basic selection or preselection, fine selection, and final selection). Depending on size and/or complexity of the evaluation, all three or even two sub-phases can be necessary (Figure 1).

Figure 1.

Selection phases.

The proposals from the selection phase are compared and evaluated according to predefined criteria. Presentations and workshops will be held for the decision-making of CRM software and CRM providers. An implementation plan is created (Table 11).

ActivitiesNomination in phaseABCD
Compare offers3, 4, 544.00003.00000.53336
Create implementation plan4, 524.50004.50001.000012
Evaluate criteria1, 2, 452.50001.80000.50005
Make decision3, 5, 745.00005.50000.964311
Make rough selection1, 4, 533.00003.33330.40954
Make selection1, 2, 3, 4, 6, 8104.50003.40000.816710
Perform fine selection2, 4, 644.00003.50000.73818
Perform preselection1, 2, 5, 693.50002.55560.21703
Perform presentations2, 433.00002.00000.16672
Perform workshops3, 624.50004.50000.65007
Select software2, 3, 433.00003.00000.80569
Tender1, 3, 633.50003.33330.10001
Perform final selection6, 827.00007.00001.000012

Table 11.

Activities in the selection phase.

3.9.1 Other activities

In the selection phase, it may be necessary to carry out market research again. Possible first tests of CRM systems are completed. Visits to reference customers of the CRM providers are prepared and carried out. For this, questions are prepared, and potential participants are determined. CRM business cases are defined. Possible CRM providers are contacted and the answered specifications pre-evaluated. Contract negotiation contracts are drafted, and initial negotiations are carried out. Detailed requirements are determined, the essential selection criteria are defined, and, if necessary, the criteria are weighted.

3.10 P10 presentation phase

During P10 phase, 1-n presentations will be held. This can also be considered as a proof of concept (Table 12).

ActivitiesNomination in phaseABCD
Perform presentations3, 4, 784.250080.68241
Proof of concept424.000020.71432

Table 12.

Activities in the presentation phase.

3.10.1 Other activities

An agenda must be created for vendor presentations. The vendor presentations should be moderated. A documentation (e.g., minutes) of each vendor presentation is created. Each vendor presentation is rated by a defined Team via defined questionnaire. For the vendor presentations, data for the prototype is provided. The activities for the vendor presentations are also valid for the proof of concept.

3.11 P11 shortlist phase

3.11.1 Other activities

A shortlist of CRM systems and CRM providers (vendors and implementation partners) must be created (Table 13). All CRM systems and CRM providers from the reduced longlist are collected in the list. Based on previous defined detailed criteria, the CRM systems and CRM providers are evaluated and reduced to a shortlist.

ActivitiesNomination in phaseABCD
Create shortlist3, 4, 544.00004.00000.76671

Table 13.

Activities in the shortlist phase.

3.12 P12 negotiation and contract phase

The focus in this phase is to design the contracts (project contract, software contract, maintenance contract) and conduct contract negotiations (Table 14).

ActivitiesNomination in phaseABCD
Carry out negotiations3, 725.00005.00000.92861

Table 14.

Activities in the project initialization phase.

3.12.1 Other activities

The negotiation strategy is defined, and the following important contract elements are identified:

  • Costs for licenses, consulting, development

  • Terms of payment

  • Travel expenses

  • Liability

  • Warranty

  • Delay

  • Approval conditions

  • Service-Level-Agreements (SLA)

  • etc.

3.13 P13 decision phase

In the decision phase, all decisions are collected, and a management summary is given. Final tests provide information and form the final basis for a definite decision (Table 15).

ActivitiesNomination in phaseABCD
Final testing1, 221.50001.50000.12502
Make decision3, 4, 5, 6, 885.50005.25001.00003
Summarize criteria121.00001.00000.00001

Table 15.

Activities in the decision phase.

3.13.1 Other activities

Possible reference customers (clients) of the final vendor are identified, contacted, and visited. During reference visits, the implementation project, the industry experience of the consultants, and the ongoing support will be discussed. The final contract negotiations are carried out. In the final phase, the most suitable system and the vendor or implementation partner are selected.

4. Conclusion

The study is interesting since viewpoints from a literature perspective as well as from a business side have been considered. The results of the qualitative content analysis (Figure 2) offer the possibility of the individual design of a procedure model for the selection of CRM systems.

Figure 2.

Thirteen-stage selection model.

The selection model can be changed or adjusted if necessary. This applies to the analyzed phases as well as to the respective activities within the phases.

5. Future work

In the qualitative analysis of CRM evaluation models, 13 phases including specific activities were identified. Based on this literature review, it is planned to conduct expert interviews. On the basis of these expert interviews, a new CRM evaluation model will be defined an afterwards tested via a quantitative analysis to confirm the results. Based on this new model, it is planned to develop guidelines how the model can be used.

Model nameNumber phasesModel typeProcedureDocument type
5 step CRM software selection guide: a pragmatist’s guide to CRM software selection [7]5SelectionGuideProduct folder
CRM Evaluierung [8]3EvaluationProduct folder
CRM implementation method [9]5SelectionProcessesConference paper
Software selection steps [10]3SelectionStepsJournal paper
Überblick über das Referenz-Vorgehensmodell [11]8SelectionReference modelDissertation
Phasen der Softwareauswahl [12]8SelectionProcessesBook
Einführung eines SFA-Systems [13]3ImplementationPhasesTechnical article
Selektionsprozess CRM-System [14]5SelectionProcessesEssay
Phasen der Softwareauswahl [15]3SelectionPhasesTechnical article
CRM-Softwareauswahl [16]6SelectionGuideGuide
CRM-Auswahl in vier Schritten zum richtigen System [17]4SelectionStepsConsultation
CRM Beratung [18]2ImplementationStagesConsultation
Übersicht über das CRM-Selektionsmodell [19]3SelectionPhasesTechnical article
Auswahlprozess [20]4SelectionPhasesConsultation
Ideale Vorgehensweise bei einer Kampagnenmanagement-Auswahl [21]8SelectionConsultation
Methodik und Vorgehen: Best Practice CRM-Entscheidungstrichter [22]4EvaluationStepsWhite paper
Drei Phasen (und ein Kick-Off) zur Auswahl ihrer CRM-Software [23]4SelectionPhasesWhite paper
Auswahl und Einführung von CRM-Systemen [24]6SelectionRoad mapStudy
Evaluationsprozess für CRM-Systeme [25]3EvaluationPhasesBachelor thesis
CRM-Projekt [26]2SelectionPhasesWhite paper
Vorgehensweie im Überblick [27]5SelectionPhasesPresentation slides

Table 16.

Overview of the evaluation models.

# of phasesSplit# of phasesSplit# of phasesSplit# of phasesSplit
10.000010.000010.000010.0000
21.000020.500020.333320.2500
31.000030.666730.5000
41.000040.7500
51.0000
# of phasesSplit# of phasesSplit# of phasesSplit# of phasesSplit
10.000010.000010.000010.0000
20.200020.166720.142920.1250
30.400030.333330.285730.2500
40.600040.500040.428640.3750
50.800050.666750.571450.5000
61.000060.833360.714360.6250
71.000070.857170.7500
81.000080.8750
91.0000

Table 17.

Normalization formula.

Download

chapter PDF

© 2019 The Author(s). Licensee IntechOpen. This chapter is distributed under the terms of the Creative Commons Attribution 3.0 License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

How to cite and reference

Link to this chapter Copy to clipboard

Cite this chapter Copy to clipboard

Christoph Weiss, Johannes Keckeis and Manfred Kofler (November 26th 2019). Qualitative Analysis of Different CRM Evaluation Models [Online First], IntechOpen, DOI: 10.5772/intechopen.89776. Available from:

chapter statistics

17total chapter downloads

More statistics for editors and authors

Login to your personal dashboard for more detailed statistics on your publications.

Access personal reporting

We are IntechOpen, the world's leading publisher of Open Access books. Built by scientists, for scientists. Our readership spans scientists, professors, researchers, librarians, and students, as well as business professionals. We share our knowledge and peer-reveiwed research papers with libraries, scientific and engineering societies, and also work with corporate R&D departments and government entities.

More About Us