Submitted:
14 June 2023
Posted:
15 June 2023
You are already at the latest version
Abstract
Keywords:
1. Introduction
2. Literature Review
2.1. Marketing Engineering Approach
2.1.1. Customer Segmentation
- Identifiability: Segments should be identifiable based on customer characteristics.
- Accessibility: The firm should be able to effectively reach and target each segment.
- Substantiality: Each segment should be large enough to justify a unique marketing strategy.
- Actionability: The firm should be able to design a value proposition that satisfies the needs of each segment.
- Stability: Segments should exhibit stable characteristics over time.
2.1.2. Optimization
- Identification of optimal solutions based on constraints and goals.
- Consideration of trade-offs between alternatives in a structured manner.
- Ability to scale to complex, multi-variable marketing decisions.
2.1.3. Experimentation
- Ability to isolate the effects of individual marketing variables.
- Avoidance of bias through random assignment of treatments.
- Quantification of uncertainties and risks through statistical analysis.
- Identification of optimal strategies that actually perform best in practice.
2.1.4. Predictive Analytics
- Identification of strategies most likely to meet objectives based on real data patterns.
- Simulation of various "what if" scenarios to compare alternative options.
- Reduction of uncertainties through probabilistic outcome forecasts.
- Ability to incorporate multiple inputs into holistic predictions.
2.2. Decision-Making Process
- Problem identification: Clearly specifying the nature and scope of the decision problem.
- Alternative generation: Using data and insights to systematically brainstorm potential solutions.
- Evaluation/selection: Weighing alternatives using quantitative and qualitative analyses.
- Implementation: Creating an action plan, assigning responsibilities and establishing metrics.
- Review: Monitoring progress, revisiting assumptions and making adjustments as needed.
- Define the problem and set objectives
- Gather relevant information through environmental scanning and research
- Generate alternatives through brainstorming sessions and modeling
- Evaluate alternatives using factor analysis, judgment analysis and simulations
- Implement the chosen alternative with control systems, feedback loops and adjustment
3. Proposed Model
- Existing normative frameworks for effective decision processes
- Practical multi-stage decision-making process models from the literature
- Principles of marketing engineering shown to enhance decision inputs if properly applied
- Research on limitations of intuition-based decision-making
- Problem framing: Clearly defining the decision context, objectives, constraints and stakeholders. This ensures a common understanding and proper scope for subsequent stages.
- Data gathering: Collecting relevant data from both internal and external sources to generate insights to inform the decision process.
- Alternative generation: Leveraging techniques like customer segmentation to systematically envision multiple possible strategies to address the decision problem. Segmentation enables targeting solutions to specific customer groups.
- Alternative evaluation: Using experiments, optimization and predictive models to evaluate and compare alternatives based on established objectives. These techniques provide objective assessments to identify the best options.
- Implementation: Developing an action plan, establishing metrics and continuously monitoring progress to successfully execute the chosen alternative. Mid-course corrections can then be made.

4. Methodology
4.1. Research Design and Sample
4.2. Sample Size
- It enables detecting medium effect sizes (d = 0.5) with 80% power using an independent samples t-test at a 0.05 significance level, as calculated using G*Power software. Given the study aims to evaluate the impact of a decision-making process model, a medium effect size was deemed plausible.
- It provides sufficient numbers in each experimental condition (model-following group vs. control group) to make valid comparisons and control for potential outliers. With 75 participants per group, the data meets the central limit theorem conditions for parametric statistical testing.
- It allows for some attrition over the 6-month duration of the experiment while still retaining adequate statistical power. Losing around 10-15% of the original sample was assumed.
- It is a feasible sample size to recruit given the availability of marketing professionals and the resources required for participation (time, scenario details, follow-up surveys).
4.3. Sampling Method
- Simple random sampling: Each marketing professional had an equal probability of being selected for the study and assigned to either group. This reduces selection bias.
- Random assignment: Participants were randomly assigned to the model-following (experimental) group vs. unaided approach (control) group using a computerized random number generator. This ensures the groups are equivalent on both measured and unmeasured characteristics.
- Probability sampling: Every member of the target population (i.e. all marketing professionals) had a known, non-zero chance of being selected. This allows for statistical inference from the sample to the wider population.
4.4. Data Analysis
4.4.1. Independent Samples t-test
- Independent observations - As participants were randomly assigned to groups, their outcomes are independent.
- Normal distribution - A Shapiro-Wilk test showed ROI was reasonably normally distributed for both groups (p > .05).
- Homogeneity of variances - A Levene's test indicated equal variances between groups for ROI (p = .126).
4.4.2. Other Analyses
4.5. Validation of Model
4.5.1. Goodness of Fit Tests (GOF)
4.5.2. Cross-Validation
4.5.3. Effect Sizes
- Cohen's d - A large effect size of 0.825, indicating a practically significant difference in mean ROI between groups.
- Hedges' g - A large corrected effect size of 0.811 to account for smaller sample sizes, also suggesting a large difference between groups.
- Glass's delta - A medium effect size of 0.388 when standardizing by the control group's standard deviation, still demonstrating a positive impact of following the proposed model.
4.5.4. Manipulation Checks
| key Stage | Model Group | Control Group | ||
|---|---|---|---|---|
| N | % | N | % | |
| Problem Framing | 138 | 92 | 97 | 65 |
| Data Gathering | 132 | 88 | 82 | 55 |
| Alternative Generation | 147 | 98 | 117 | 78 |
4.5.5. Sensitivity Analysis
| B | SE | Wald χ2 | P | OR | 95% CI | |
|---|---|---|---|---|---|---|
| Decision Process | 1.42 | 0.09 | 258.11 | <0.001 | 4.15 | [3.13, 5.51] |

5. Results
- Segment customers based on meaningful criteria during problem framing (χ2 =12.57, p <0.001)
- Conduct relevant quantitative experiments during solution generation (χ2 =9.32, p <0.01)
- Optimize parameters based on experiment results during solution validation (χ2 =16.07, p <0.001)
- (a)
- Systematically following the proposed 5-stage decision-making process model, which integrates marketing engineering principles, can significantly enhance marketing decision outcomes as measured by ROI.
- (b)
- The effectiveness of the model is likely attributable to its emphasis on analytical techniques at key stages, nudging decision makers to segment customers meaningfully, run relevant experiments, and optimize parameters - all of which improve decision inputs and quality.
6. Discussion
7. Limitations and Future Research Directions
- Representativeness of Sample: The study sample of marketing professionals recruited online may not represent the full population of marketing decision makers. Probability sampling of a more representative sample in future research can improve external validity.
- Scenario Realism: The experimental scenario of allocating a marketing budget may not fully reflect complex real-world marketing decisions. Future experiments employing industry-specific scenarios can improve ecological validity.
- Limited Decision Context: The single decision context examined may not generalize to other marketing decision types. Future research should test the model across multiple decision contexts and industries.
- Self-Report Measures: The reliance on self-reported ROI and technique usage is subject to biases. Future experiments utilizing objective outcome metrics where feasible can increase validity.
- Moderators: The study did not examine potential moderators of the model's effectiveness, such as decision-maker characteristics. Identifying boundary conditions would refine theory.
- Cross-Sectional Design: The study captured a single time point, precluding examination of long-term or changing effects. Longitudinal designs can address this limitation.
- Potential Confounders: Though groups were equivalent on measured variables, unmeasured confounds due to the non-experimental design cannot be ruled out. Future experiments employing random assignment and manipulation checks can address this threat.
- Lack of Process Measures: The study did not measure process aspects of how the decision-making model was implemented, limiting theoretical insights. Future research can integrate process measures.
8. Conclusion
7.1. Theoretical Contributions
- It develops the first integrated marketing engineering-based decision-making process model capable of systematically guiding marketing decisions from start to finish. This advances theoretical conceptualization of how structured, evidence-based decision processes can optimize marketing outcomes.
- The proposed model integrates key marketing engineering principles - segmentation, experimentation, optimization and predictive analytics - into a comprehensive decision framework. This translation of available knowledge into an actionable model advances theoretical understanding.
- The preliminary findings suggest marketing engineering techniques may mediate the impact of structured decision processes on outcomes through their impact on decision inputs. This points to potential psychological mechanisms underlying the model's effectiveness.
- The study identifies several limitations of the current research which, if addressed through future research, can refine and extend theory on structured decision processes in marketing. This clarifies avenues for theoretical advancement.
7.2. Methodological Contributions
- The experimental research design utilizing random assignment of participants to conditions aims to control for selection bias and other confounding variables that could explain the results. This strengthens our ability to attribute observed differences in outcomes to the intervention - in this case, following the 5-stage decision making process model.
- The use of an objective outcome measure (ROI) minimizes common method bias and increases the validity of results compared to self-reported dependent variables. ROI also represents a meaningful, real-world metric of marketing decision performance.
- The systematic data collection procedures via survey and experiment ensure a rigorous and structured approach that can be replicated and built upon by future research.
- The employment of multiple statistical analyses including normality tests, homogeneity of variance tests and examination of survey data enhances the validity of results by thoroughly examining the data from multiple angles and checking key assumptions.
- Identification and discussion of limitations of the current methodology - including limitations of the experiment's scenario and self-report measures - pinpoints avenues for improvement in future research that can address the limitations and build confidence in the findings.
7.3. Practical Implications
- Rigorous, Evidence-Based Process: The results demonstrate that adopting a rigorous, systematic and evidence-based decision-making process can meaningfully improve marketing performance. This highlights the value of moving from intuition-driven to data-driven and analytically optimized decision-making.
- Actionable Decision Framework: The proposed 5-stage decision making process model offers marketers a practical and actionable framework they can implement, test and refine within their own organizations. Following the key steps and integrating analytical techniques at each stage can guide marketing teams toward optimal decisions.
- Leveraging Marketing Engineering Techniques: The various marketing engineering techniques integrated into the model - including customer segmentation using meaningful criteria, marketing experimentation to validate hypotheses, and iterative optimization using analytics - represent concrete actions marketers can take to inform and refine their decisions at each stage.
- Process and Analytics as Complementary Approaches: The research suggests marketers should view structured decision processes and evidence-based analytical techniques as complementary rather than incompatible approaches for optimizing marketing decisions and performance. Combining the two offers a powerful solution.
Appendix A



References
- Bajari, P.; Chu, C. S.; Hong, H.; Nekipelov, D. Economic analysis of targeted marketing and advertising. Annual Review of Economics 2019, 11, 471–505. [Google Scholar]
- Chan, W.; Christensen, B. A.; Dombrowski, C.; Even, A. Leading the charge: Decision making and strategic planning transform rural electric cooperatives. Journal of Economic and Financial Sciences 2019, 12, 1–9. [Google Scholar]
- Chan, W.; Li, S. Y.; Lee, T. H. Big data applications in e-commerce and supply chain management: Benefits and challenges. International Journal of Production Economics 2019. [Google Scholar]
- Chang, H. H.; Zhang, M.; Lu, J. X.; Lin, K.; Wang, H. Theory and methodology of marketing decision-making based on big data and artificial intelligence: Trends, frameworks, and methods. Information & Management 2021, 103392. [Google Scholar]
- Christensen, C.; Cook, S.; Dorotic, M.; Eyupoglu, N.; Hall, B.; Verhoef, P. Marketing in the age of analytics: Research imperatives. Journal of Interactive Marketing 2018, 41, 24–39. [Google Scholar]
- Liu, S.T.; Clemen, R.T. Making Hard Decisions, an Introduction to Decision Analysis. Technometrics 1992, 34, 365. [Google Scholar] [CrossRef]
- De Bono, E. Serious creativity: Using the power of lateral thinking to create new ideas. HarperBusiness. 1992. [Google Scholar]
- Dorotic, M.; Bijmolt, T.H.; Verhoef, P.C. Loyalty Programmes: Current Knowledge and Research Directions*. Int. J. Manag. Rev. 2011, 14, 217–237. [Google Scholar] [CrossRef]
- Gigerenzer, G.; Gaissmaier, W. Heuristic decision making. Annual Review of Psychology 2011, 62, 451–482. [Google Scholar] [CrossRef]
- Hastie, R., & Dawes, R. M. (2010). Rational choice in an uncertain world: The psychology of judgment and decision making. Sage.
- Hillier, F. S., & Lieberman, G. J. (2015). Introduction to operations research. McGraw-Hill Education.
- Kahneman, D. (2011). Thinking, fast and slow. Macmillan.
- Kohavi, R., Deng, A., Frasca, B., Walker, T., Xu, Y., & Pohlmann, N. E. (2009). Online controlled experiments at large scale. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 1168-1176).
- Kohavi, R.; Longbotham, R.; Sommerfield, D.; Henne, R.M. Controlled experiments on the web: survey and practical guide. Data Min. Knowl. Discov. 2008, 18, 140–181. [Google Scholar] [CrossRef]
- Kumar, V. Evolution of marketing as a science–the living dead and the missing link. Journal of Marketing 2015, 79, 35–46. [Google Scholar]
- Leeflang, P. S.; Parsons, A. Return on marketing investment: Key metric for marketing accountabilit. Journal of the Academy of Marketing Science 2019, 47, 881–894. [Google Scholar]
- Lilien, G. L., Rangaswamy, A., Van Bruggen, G. H., & Starke, K. (2017). Marketing engineering: Computers and analytical methods in marketing. Springer.
- Mohebbi, B. The art of science-based business: The emerging discipline of marketing engineering. Industrial Marketing Management 2019, 83, 129–135. [Google Scholar]
- Oralhan, A.; Ulusoy, G. How data analytics capabilities help firms improve marketing decision making? Information Systems Frontiers 2020, 1–22. [Google Scholar]
- Oralhan, Y.; Ulusoy, S. Marketing engineering for analytics-based decision-making: Literature review and a research agenda. Journal of Industrial Engineering and Management 2020, 14, 137–157. [Google Scholar]
- Phillips, P. P., Phillips, J. J., & Aaron, B. (2019). Gower handbook of training and development. Routledge.
- Reinartz, W.; Kollar, P. The general theory of marketing management: Standardizing the fundamentals beyond replicating successful practices. Journal of Marketing 2020, 84, 24-4. [Google Scholar]
- Sahni, N.; Chintagunta, P. K.; Kishore, V. Marketing–R&D integration and new product performance: An empirical investigation. Marketing Science 2015, 34, 743–762. [Google Scholar]
- Seifert, D. W.; Henderson, D. E.; Hensel, D. J.; MacMillan, S. Optimizing and simulating dynamic marketing budgets. Journal of the Academy of Marketing Scienc 2018, 46(5), 848–866. [Google Scholar]
- Seifert, M.; Burmeister, A.; Swenson, M. J. Improving decision making in marketing with optimization. Decision Sciences 2018, 49(2), 159–194. [Google Scholar]
- Sharma, M. K.; Taylor, M. J. Five step approach for effective decision making. Global Journal of Enterprise Information System 2015, 7(1), 44–48. [Google Scholar]
- Sharma, R., & Taylor, G. S. (2015). Effective decision making. In Effective Performance Management (pp. 147-165). Routledg.
- Shmueli, G., Patel, N. R., & Bruce, P. C. (2016). Data mining for business analytics: concepts, techniques, and applications in R. John Wiley & Sons.
- Smith, B. D.; Zilberman, D.; Goldsmith, P. D. Economics of sustainable marketing, global food security, and agricultur. Applied Economic Perspectives and Policy 2020, 42(1), 15–37. [Google Scholar]
- Smith, W. R. Product differentiation and market segmentation as alternative marketing strategies. Journal of marketing 1956, 20, 3–8. [Google Scholar] [CrossRef]
- Tang, F. F.; Yang, P.; Chou, T. Y. Data analytics in marketing. Journal of Business & Industrial Marketing 2018. [Google Scholar]
- Tversky, A.; Kahneman, D. Judgment under Uncertainty: Heuristics and Biases. Science 1974, 185, 1124–1131. [Google Scholar] [CrossRef] [PubMed]
- Von Neumann, J., & Morgenstern, O. (1947). Theory of games and economic behavior. Princeton university press.
- Von Winterfeldt, D., & Edwards, W. (1986). Decision analysis and behavioral research. Cambridge university press.
- Weiss, A. M. (2013). Marketing: An Introduction. PHI Learning Pvt. Ltd.
| Group | n | Mean | ROI | SD | t | df p |
|---|---|---|---|---|---|---|
| Experimental | 75 | 19.3% | 4.1% | 3.14 | 148 | .002 |
| Control | 75 | 16.4% | 6.3% |
| Element | Experimental Group | Control Group |
|---|---|---|
| Customer Segmentation | 76% | 46% |
| Experimentation | 89% | 34% |
| Optimization | 89% | 34% |
| Independent Variable | B | SE | Wald χ2 | p |
|---|---|---|---|---|
| Intercept | 0.56 | 0.13 | 18.85 | <0.001 |
| Decision Process | 0.80 | 0.09 | 78.25 | <0.001 |
| Set | n | Mean ROI | Std. Deviation |
|---|---|---|---|
| Training | 105 | 17.5% | 4.21 |
| Test | 45 | 17.2% | 4.13 |
| Standardizer | Point Estimate | 95% Confidence Interval | ||
|---|---|---|---|---|
| Lower | Upper | |||
| Cohen’s d Hedges' g Glass's delta |
1.000 0.984 0.388 |
0.825 0.811 0.319 |
0.578 0.553 0.104 |
1.072 1.061 0.525 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).