Category: Programming

Issuing vs Acquiring Banks for Card Payments

Issuing vs Acquiring Banks for Card Payments
Issuing vs Acquiring Banks for Card Payments

Mark Whitfield IT Project Manager, Brief Summary

Mark Whitfield is a highly experienced, SC-cleared Senior Project Manager and IT professional with over 31 years of experience in both public and private sectors, specializing in software development, cloud migration, and IT systems delivery.

He is currently associated with Capgemini (since 2016) and runs a project management resource website, PROject Templates.

Joined Capgemini in 2016 having worked at ascending points in software development lifecycle projects for over 31 years
Joined Capgemini in 2016 having worked at ascending points in software development lifecycle projects for over 31 years

Key Qualifications & Experience:

  • Roles: Senior Project Manager, Engagement Project Manager, Delivery Manager, and former programmer.
  • Methodologies: PRINCE2 Practitioner, skilled in both Waterfall and Agile (SCRUM) approaches.
  • Sector Experience: Extensive experience in finance and banking, including ATM software swap-outs, cloud migration (Azure, AWS, Power Platform), and POS monitoring systems.
  • Background: Graduated in Computing in 1990; worked as a developer (COBOL, SQL, Tandem / HPE NonStop) before transitioning to project management.
PRINCE2 Practitioner, skilled in both Waterfall and Agile (SCRUM) approaches
PRINCE2 Practitioner, skilled in both Waterfall and Agile (SCRUM) approaches

Professional Highlights:

  • Delivered major projects for clients such as Barclays, Bank of England, HSBC, Royal Mail Group, UK & Welsh Government, Heathrow, and Jaguar Land Rover.
  • Led complex IT infrastructure projects and business transformations.
  • Maintains mark-whitfield.com, offering over 200 project management templates, trackers (RAID, budget, benefit, cost etc.), and many plans for Agile / Waterfall projects including 30+ Plan On a Page (POaP) and MS Project MPP examples (click on Blog above for a summary).
  • Provides specialized templates for PRINCE2 7th edition and MS Project (MPP).
December 2022 – C&CA UK’s Communications & Engagement Award Winner – Cloud & Custom Applications – Capgemini UK
December 2022 – C&CA UK’s Communications & Engagement Award Winner – Cloud & Custom Applications – Capgemini UK
November 2017 – Advanced Engagement Management Course – Level 2 Exam
November 2017 – Advanced Engagement Management Course – Level 2 Exam
June 1990 – Higher National Diploma in Computer Studies (DISTINCTION – overall top) – BIHE
June 1990 – Higher National Diploma in Computer Studies, Distinction

Read more…

Data Engineering Summary

Data Engineering Summary
Data Engineering Summary
Data Engineering : Step by Step Summary
Data Engineering : Step by Step Summary

Extract, Transform, Load (ETL) is a foundational data integration process that consolidates raw data from multiple disparate sources—such as CRM systems, databases, and APIs—into a single, centralized destination, typically a data warehouse or data lake. It is crucial for ensuring that data is clean, consistent, and ready for analytics, BI reporting, and machine learning.

Core ETL Process Steps

  1. Extract: Raw data is pulled from varied sources (structured or unstructured) into an intermediate staging area.
  2. Transform: The staged data is cleaned, formatted, and combined based on business rules to ensure consistency.
  3. Load: The prepared data is moved from the staging area into the final target data warehouse.

Key Benefits

  • Data Quality & Consistency: Standardizes formats (e.g., date formats, currency) and cleans up errors.
  • Historical Context: Combines legacy data with new information for long-term analysis.
  • Automation: Automates recurring data processing tasks, saving time for data engineers.

ETL vs. ELT

  • ETL (Transform before Loading): Transforms data on a separate processing server before loading, ideal for complex, heavy transformations.
  • ELT (Load then Transform): Loads raw data directly into the target warehouse (e.g., Snowflake, BigQuery) and transforms it using the warehouse’s power. This is better for large, unstructured datasets.

Detailed Summary

1. Extract

Extraction is the first phase, where raw data is gathered from various heterogeneous sources.

  • Sources: SQL servers, NoSQL databases, SaaS applications (CRM/ERP), JSON/XML files, and IoT sensors.
  • Methods:
    • Full Extraction: The entire source is copied; best for small tables.
    • Incremental Extraction: Only data modified since the last run is extracted.
    • Update Notification: Source system alerts the ETL tool of a change.
  • Staging Area: Extracted data is temporarily stored in a “staging area” (or landing zone) to avoid placing heavy loads on production systems during transformation.

2. Transform

This is the most compute-intensive phase, where raw data is converted into a usable format.

  • Cleansing: Mapping NULL values to 0, removing duplicates, and fixing errors.
  • Standardization: Converting character sets, date/time formats, or measurement units (e.g., kilograms to pounds).
  • Data Aggregation: Summarizing data (e.g., total sales per store per day).
  • Enrichment/Derivation: Creating new calculated values (e.g., calculating profit from revenue and cost).
  • Encryption/Masking: Anonymizing PII (Personally Identifiable Information) to comply with GDPR/HIPAA regulations.

3. Load

The final phase transfers the cleaned and transformed data into the target destination.

  • Target Systems: Data warehouses (e.g., Amazon Redshift, Snowflake, Google BigQuery) or Data Lakes.
  • Loading Methods:
    • Full Load: Wiping and replacing all data in the target.
    • Incremental Load: Only loading new/updated data (the “delta”) to the target at regular intervals.
  • Automation: The process is typically automated to run during off-hours, ensuring the data is ready for morning reports.

Modern Trends and Tools

  • Cloud-Native ETL: Tools like AWS Glue, Azure Data Factory, and Google Cloud Dataflow allow for serverless, scalable data integration.
  • Reverse ETL: Moving transformed data from the warehouse back to operational systems (like Salesforce) to activate insights.
  • Streaming ETL: Processing data in real-time as it arrives, rather than waiting for batch updates, using tools like Apache Kafka.
  • DataOps: Applying DevOps principles (automation, testing) to data pipelines to ensure reliability and faster deployment.

When to Choose ETL vs. ELT

  • Choose ETL when: You need to comply with strict data security, perform complex transformations before data hits the warehouse, or have limited computing power in your target database.
  • Choose ELT when: You are using a cloud warehouse, dealing with massive unstructured data volume, or need high-speed ingestion.

CrestCo Ltd, now Euroclear UK & International (EUI)

CrestCo Ltd, now operating as Euroclear UK & International (EUI), is the central securities depository (CSD) for the United Kingdom and Ireland, responsible for the electronic settlement of securities transactions.

Founded in the mid-1990s, CrestCo revolutionized London’s financial markets by moving them from paper-based share certificates to a “dematerialised” (electronic) system, thereby significantly reducing settlement times, risks, and costs.

Worked on-site at CrestCo in 1997 coding volume testing software

Detailed Overview: CREST and CrestCo

  • Purpose: The CREST system (Certificateless Registry for Electronic Share Transfer) enables electronic, real-time settlement of securities.
  • Services: It handles settlement of UK and Irish equities, gilts (government bonds), and various other corporate securities.
  • Key Functions:
    • Dematerialisation: Eliminating the need for physical share certificates.
    • Real-time Settlement: Reducing operational and credit risk.
    • Corporate Actions: Managing dividend payments and other corporate events.
    • CDIs: Utilizing CREST Depositary Interests (CDIs) to facilitate trading of international securities.
  • Transformation: In 2002, CrestCo was acquired by Euroclear and later renamed Euroclear UK & Ireland Ltd (EUI).

Comprehensive Timeline by Year

  • 1993: The Bank of England initiates the CREST project to replace the aborted TAURUS system (Transfer and Automated Registration of Uncertified Stock), aiming to digitize London’s settlement.
  • 1996: CrestCo Ltd is officially founded and the CREST system goes live, beginning the shift from paper-based settlements to electronic transfers.
  • 1997-1998: Rapid adoption of the system by market participants, facilitating faster settlement cycles.
  • 1999: Introduction of automated “settlement discipline” regimes, including league tables and fines to incentivize performance.
  • 2002: Euroclear merges with CrestCo. CrestCo is integrated into the Euroclear group, marking its transformation into a larger, internationally integrated entity.
  • 2007 (July 1): CRESTCo Ltd officially changes its name to Euroclear UK & Ireland Ltd (EUI).
  • 2010 (September 1): EUI merges with EMX Company Limited, enhancing its ability to handle investment funds and expanding its network.
  • 2016: CISI reports that CREST has successfully provided 20 years of secure, efficient settlement, solidifying its role in UK financial infrastructure.
  • 2020s: Continued enhancement of the system, including improved digital security and adaptation to evolving European Union and UK regulatory standards.
  • 2024: Continued operation as a premier infrastructure provider under Euroclear.
  • 2026 (April): Euroclear UK & International Ltd continues to operate as the leading CSD in London, with ongoing focus on digital asset security and efficient settlement.

Key Impacts on London Financial Markets

  • Risk Reduction: Shifted settlement risk from days to near real-time.
  • Efficiency: Drastically reduced manual processing (“mundane practices”) and associated costs.
  • Integration: Facilitated the integration of UK markets into the broader European infrastructure.

CrestCo Ltd, now operating as Euroclear UK & International (EUI)

AI Made Websites, Advantages & Disadvantages

AI Made Websites, Advantages & Disadvantages

Mark Whitfield is a Senior IT Project Manager

Mark Whitfield is a Senior IT Project Manager and Engagement Manager with over 30 years of experience in the software development lifecycle (SDLC), specializing in digital transformation, payment systems, and HPE NonStop (Tandem) technology.

He is SC cleared (valid until 2031) and currently works at Capgemini UK, having transitioned from a technical programming background to senior project leadership roles. 

He is also the creator of PROject Templates, providing a comprehensive, editable suite of over 200 project management tools built over 24+ years of experience. 

Comprehensive Career Timeline by Era

1. Technical Foundations & Mainframe Development (1990–1995) 

  • 1990: Graduated in Computing at University of Bolton; started as a programmer at The Software Partnership (later Deluxe Data), Runcorn.
  • 1990–1994: Specialised in electronic banking software (sp/ARCHITECT-BANK) on Tandem Mainframe Computers (HPE NonStop), developing in COBOL85 and NonStop SQL for major banks.
  • 1994: Developed batch billing modules for Barclays Business Master II (BBM II) on-site in Knutsford and Poole.

2. Advanced Technical Management & Product Focus (1995–2013) 

  • 1995–2013: Worked at Insider Technologies Limited as Senior Development Engineer/ Project Manager.
  • 1997: Conducted volume testing/benchmark software for CRESTCo (now Euroclear) on new S7000 hp NonStop nodes.
  • 2002: Managed and attained the first HP OpenView Operations 2-way Smart Plug-In (SPI) certification for the HPE NonStop platform.
  • 2000s (Early): Developed RTLX (Real-Time Log Extraction) for BASE24 POS and ATM transaction monitoring, collaborating with banking clients like HSBC and Global Payments.
  • 2013: Delivered a large BASE24 transaction tracking project at Al Rajhi Bank in Riyadh, Saudi Arabia. 

3. Senior Project Management & Banking Upgrades (2013–2016) 

  • 2013–2014: Senior Project Manager at Wincor Nixdorf UK, managing a £5M+ ATM/POS software replacement programme (Self-Service Software Replacement) for Lloyds Banking Group (LBG).
  • 2014–2016: Senior IT Digital Project Manager at Betfred, delivering online and mobile platform projects (iOS/Android) using Agile SCRUM. 

4. Digital Engagement & Cloud Transformation (2016–Present)

  • 2016: Joined Capgemini UK as a client-facing Engagement Manager (SC Cleared).
  • 2016–2017 (Aerospace): Managed Agile delivery for air traffic control iOS apps.
  • 2016–2017 (Postal): Project Manager for a £4.3M migration of 1100+ interfaces for a major postal client.
  • 2017–2018 (Automotive): Managed a £670K Customer Portal/ New Car Online Sales project and Digital Readiness project.
  • 2018–2019 (MuleSoft): Augmented as Delivery Manager for MuleSoft Professional Services, managing API-led projects.
  • 2020–Present (UK Government): Led various MS Azure and Cloud migration projects, including a £13.5m programme to migrate 130 UK government apps. 

Key Areas of Expertise

  • Methodologies: Agile (SCRUM), Waterfall, PRINCE2 Practitioner, ITIL.
  • Technical Knowledge: HPE NonStop (Tandem), BASE24, Middleware, Cloud (AWS/Azure), PCI DSS Compliance.
  • Sector Experience: Retail Banking, Public Sector, Aerospace & Defence, Automotive, Gambling & Casino. 

PROject Templates Resource Overview

Mark Whitfield provides an extensive and fully editable project management template bundle (200+) developed from his 30+ year career. 

  • Format: Excel, PowerPoint (PPT), Word (DOC), and MS Project (.mpp msp mpt).
  • Key Templates:
    • Planning: Plan on a Page (POaP), Detailed Project Plans (Waterfall/Agile).
    • Tracking: RAID logs (Risk, Action, Issue, Dependency/Decision), Budget & Burn Tracking (Actuals vs Forecasts).
    • Governance: Status Reports, RACI, Stakeholder Analysis, Project Delivery Checklists.
  • Key Features: Designed for immediate use, fully customizable, and offers free lifelong upgrades and additions. 

Tandem Computers ( HPE NonStop ) Overview & Detailed Timeline

Tandem Computers, founded in 1974 by James (Jimmy) Treybig, revolutionized the computing industry by pioneering fault-tolerant computer systems. Designed specifically for online transaction processing (OLTP) in banking, stock exchanges, and telephone switching, Tandem’s “NonStop” systems provided near-zero downtime by utilizing redundant, modular processors and a “shared-nothing” architecture. 

Tandem remained an independent, rapidly growing company until it was acquired by Compaq in 1997, later becoming part of Hewlett Packard Enterprise (HPE). 

Overview of Key Technologies

  • NonStop Architecture: The core design featured multiple independent processors, each with its own memory and I/O bus, interconnected by a redundant inter-CPU bus called the Dynabus.
  • Guardian OS: A message-based operating system designed to detect faults immediately (“fail-fast”) and mirror process states to a backup processor, allowing seamless failover.
  • NonStop SQL (1986): The first fault-tolerant SQL database, known for linear scalability.
  • ServerNet (1995): A high-speed, scalable, point-to-point network system that replaced the Dynabus and influenced modern InfiniBand standards. 

Detailed Historic Timeline by Era and Year

The Founding Era (1974–1979) 

  • 1974: Tandem Computers is founded in Cupertino, California, by Jimmy Treybig, formerly of HP. Initial venture capital investment comes from Kleiner & Perkins.
  • 1975: Design of the Tandem/16 (T/16) is completed.
  • 1976: The first T/16 NonStop system is shipped to Citibank.
  • 1977: Tandem goes public; sales begin rapid, exponential growth.
  • 1978: Introduction of the ENCOMPASS database management system.

The Growth and Competition Era (1980–1989)

  • 1980: Inc. magazine ranks Tandem as the fastest-growing public company in America.
  • 1981: NonStop II is introduced, supporting 32-bit addressing to allow for larger applications.
  • 1982: Competition intensifies as Stratus Technologies enters the fault-tolerant market. Tandem faces its first quarter of declining growth.
  • 1983: Introduction of the NonStop TXP, the first entirely new implementation of the TNS architecture with cache memory.
  • 1985: Attempted entry into the PC market with the MS-DOS-based Dynamite PC, which fails commercially and is withdrawn.
  • 1986: Introduction of the NonStop VLX (32-bit datapath) and the revolutionary NonStop SQL database.
  • 1987: Introduction of the low-cost NonStop CLX for small office environments.
  • 1988: Tandem acquires Ungermann-Bass, Inc. to strengthen networking capabilities.
  • 1989: Introduction of the NonStop Cyclone, a high-end ECL-based processor aimed at mainframe markets. 

The Open Standards & MIPS Transition Era (1990–1996)

  • 1990: Tandem introduces the Integrity line of fault-tolerant Unix systems.
  • 1991: Cyclone/R (CLX/R) is released, marking the start of the migration from proprietary stack machines to MIPS R3000 RISC microprocessors.
  • 1993: Introduction of the NonStop Himalaya K-series using faster MIPS R4400 processors.
  • 1994: NonStop Kernel (NSK) is extended with Open System Services (OSS), a POSIX-compliant Unix environment.
  • 1995: Introduction of ServerNet, designed for extremely low-latency inter-processor communication.
  • 1995–1997: Partnered with Microsoft on the “Wolfpack” project, which becomes Microsoft Cluster Server. 

Acquisition and Integration Era (1997–Present)

  • 1997: Compaq acquires Tandem Computers for roughly $3 billion. The Himalaya S-Series is introduced.
  • 1998: Compaq acquires DEC, leading to a shift in engineering strategy towards Alpha/Itanium instead of MIPS.
  • 2001: Compaq terminates Alpha engineering, committing to Intel’s Itanium (Merced) processors.
  • 2002: Hewlett-Packard acquires Compaq. Tandem becomes the core of the HP Integrity NonStop Server division.
  • 2005: The first HP Integrity NonStop servers (TNS/E) based on Itanium processors are released.
  • 2014: Completion of the migration to Intel x86 architecture (NonStop X). 

Note: Following the split of HP into Hewlett Packard Enterprise (HPE) and HP Inc., the NonStop product line continues to be developed and supported by HPE.

Tandem Computers Overview and Detailed Timeline

IT Mark Whitfield, SC Cleared Senior Project Manager

Mark Whitfield is a highly experienced SC cleared Senior IT Project Manager and Engagement Manager with over 30 years in the IT industry, specializing in both Agile and Waterfall delivery for large-scale blue-chip companies, digital projects, and payment systems. After starting as a programmer, he transitioned into project management, eventually working with Capgemini and establishing a professional templates resource site. 

SC cleared Senior IT Project Manager and Engagement Manager

IT Project Management Overview

  • Key Expertise: Senior IT Project Management (Agile / Scrum / Waterfall / PRINCE2), Delivery Management, Business Transformation, and SC clearance.
  • Sector Focus: Banking, Finance, Transportation (Heathrow, NATS), Retail, Government (Local Regional Government – LRG), Aerospace & Defence, and Gambling.
  • Technical Background: Programming in COBOL85, Tandem TAL, SQL, C, C++, Java, and experience with HPE NonStop (BASE24) systems.
Tandem TAL Programming certificate, 1995
  • Tools & Methodologies: PRINCE2, Agile SCRUM, Microsoft Project (MPP), Excel RAID logs, and Jira.
  • Value Proposition: Focuses on improving revenue, cost, and Customer Satisfaction (CSAT) through structured SDLC methodologies. 

Detailed Historical Timeline

Era 1: Programming & Technical Development (1990–1995) 

  • 1990: Graduated in Computing and joined The Software Partnership (later Deluxe Data) in Runcorn as a programmer specializing in electronic banking software (sp/ARCHITECT) on Tandem Computers (now HPE NonStop).
  • 1990-1995: Developed code (COBOL85/NonStop SQL) for major banks, including TSB, Bank of Scotland, Rabobank, and Girofon.
  • 1993 (May): Completed Tandem Guardian Principles Course.
Tandem Guardian Principles Course, 1993
  • 1994: Deluxe Electronic Payment Systems acquired The Software Partnership.
  • 1995 (June): Completed HP NonStop Performance Analysis and Tuning.
Deluxe Electronic Payment Systems acquired The Software Partnership in 1994
HP NonStop Performance Analysis and Tuning, 1995

Era 2: Specialized Software & Product Management (1995–2013) 

Insider Technologies Limited (ITL) in Salford Quays
  • 1995 (August): Joined Insider Technologies Limited (ITL) in Salford Quays as a senior programmer, later moving into product / project management.
  • 1995-2013: Focused on monitoring (Reflex) and batch scheduling (MultiBatch) software for HPE NonStop systems, serving clients like Barclays and Alliance & Leicester.
  • 2000 (May): Completed Microsoft Project ’98 Certification and began training other ITL project managers on scheduling best practices.
  • 2007: Insider Technologies products (Reflex) integrated into FIS solutions.
  • 2013: Published work in the HP NonStop journal “The Connection”. 
HPE NonStop journal “The Connection” – article for the Insider Technologies product, RTLX

Era 3: Senior IT Project Management (2013–2016) 

  • 2013-2014: Worked at Wincor Nixdorf as an IT Project Manager (PRINCE2 / Agile Scrum) on a £5m+ LBG Self-Service Software Replacement (SSSR) program for Lloyds Banking Group, migrating ATM systems from HP NonStop to AIX.
  • 2014-2016: Joined Betfred as a Senior Project Manager, delivering payment gateways, sportsbook, and virtual gaming projects in Agile SCRUM for mobile and online platforms. 

Era 4: Engagement Management & Public Sector (2016–Present) 

  • 2016 (January): Joined Capgemini UK as a client-facing Engagement Manager (SC cleared).
  • 2016 (August): Founded Mark Whitfield Consultancy Ltd, managing independent IT, network, and improvement projects.
  • 2016-2018: Led Waterfall / Agile projects for automotive, local government, and postal services.
  • 2018-2019: Augmented into MuleSoft as a Delivery Manager for the Anypoint Platform.
  • 2023-2024 (Nov-Feb): Served as Technical Delivery Manager for a UK Government account, overseeing a £1m+ Fish Export Service (FES) to Common Entry Health Document (CHED) Inspection Portal (CHIP) project.
  • 2026: Continued to provide project management thought leadership and template resources for Agile/Scrum/PRINCE2. 
Agile Scrum Burn down Chart template in Microsoft Excel
Microsoft Project MPP MSP Project Plan Template examples
Plan On a Page POaP templates plus MPP MS Project and MS Excel Project Plan templates

Key Projects & Clients

  • UK Gov / Capgemini: Fish Export Service (FES) Cloud Migration.
  • MuleSoft: Anypoint Platform.
  • Wincor Nixdorf/Lloyds: ATM/Self-Service Software Replacement.
  • Jaguar Landrover (JLR), Heathrow, Royal Mail Group, NATS, Euroclear: Various IT and Digital projects.
  • Banking: Rabobank, Barclays, HSBC, Bank of England, Standard Chartered. 

IT Mark Whitfield, SC Cleared Senior Project Manager