I'm trying to write a simple R sequence clustering/grouping/simplification solution. I'm rather a beginner, haven't used R for a while, so please forgive simple and stupid questions/solutions. Tasks are taken from SAP and they represent execution of P2P process.
Overview:
Input: After some suggestions I think that the input data should cover words instead of their ids (we don't want to compare numbers but simplify word sequences)
Option 1: sequences of steps in SAP P2P, like:
Sequence 1:Purchase Order/NB > Goods Receipt/TA > Invoice Receipt/NA > Goods Receipt/TA
Sequence 2:Purchase Order/NB > Goods Receipt/TA > Invoice Receipt/NA
My data set contains around 700 sequences (test 100), they are both short (5 steps) and long (even more than 50).
Issue is that I don't (during results interpretation) want to compare all i.e. 700 sequences but somehow I want to distinguish similar ones. Often, especially for long sequences difference is spotted after i.e. 20 steps, example:
Seq1: PR > PO > GR > IR > GR > IR > GR > IR > Payment
Seq2: PR > PO > GR > IR > IR > GR > GR > IR > Payment
At the end it should lead to spotting inefficiencies in the process executions. My question is, do you have any suggestions how I can approach that king of issue? After reading your comments I don't think that the clustering approach is the right one. I don't really care whether we should use clusters or something else, what matters is the simplification of flows.
I will appreciate any hints, suggestions, etc.
Test Data (> is used as a separator).
text_data <- c("Invoice Posting (Logistics invoice) > Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase order/NB", "Purchase order/NB > Goods Receipt/WE",
"Purchase order/NB > Goods Receipt/WE > Goods Return/WE", "Purchase order/NB > Goods Receipt/WE > Goods Return/WE > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Posting (Account maintenance) > Invoice Receipt (Account maintenance)/AE",
"Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE",
"Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Clearing /ZA",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice)",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /ZA",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Clearing /KZ > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /ZA",
"Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/ZI > Invoice Posting (Logistics invoice) > Clearing /AB",
"Purchase order/NB > Goods Return/WE", "Purchase order/NB > Goods Return/WE > Credit Note (Logistics invoice)/RE > Credit Note Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/NB > Goods Return/WE > Credit Note (Logistics invoice)/RE > Credit Note Posting (Logistics invoice) > Clearing /ZA",
"Purchase order/NB > Goods Return/WE > Credit Note Posting (Account maintenance) > Credit Note (Account maintenance)/AE",
"Purchase order/NB > Goods Return/WE > Credit Note Posting (Logistics invoice) > Credit Note (Logistics invoice)/RE > Clearing /KZ",
"Purchase order/NB > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase order/NB > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Clearing /ZA",
"Purchase order/NB > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Clearing /KZ",
"Purchase order/UB", "Purchase order/UB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE",
"Purchase order/ZB", "Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/IE > Clearing /ZA",
"Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/IE > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Clearing /ZA",
"Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Invoice Posting (Logistics invoice)",
"Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Invoice Posting (Logistics invoice) > Clearing /ZA",
"Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE",
"Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Clearing /ZA",
"Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/IE > Clearing /ZA",
"Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Clearing /ZA",
"Purchase order/ZR", "Purchase order/ZR > Goods Receipt/WE",
"Purchase order/ZR > Goods Receipt/WE > Goods Return/WE", "Purchase order/ZR > Goods Receipt/WE > Goods Return/WE > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Posting (Account maintenance) > Invoice Receipt (Account maintenance)/AE",
"Purchase order/ZR > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE",
"Purchase order/ZR > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Account maintenance)/AE > Invoice Posting (Account maintenance)",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice)",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /AB",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /AB > Credit Note (Logistics invoice, cancel)/RE > Credit Note Posting (Logistics invoice, cancel) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /AB > Credit Note (Logistics invoice, cancel)/RE > Invoice Receipt (Logistics invoice)/RE > Credit Note Posting (Logistics invoice, cancel) > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /AB > Credit Note (Logistics invoice, cancel)/RE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Credit Note Posting (Logistics invoice, cancel) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Credit Note (Logistics invoice)/RE > Credit Note Posting (Logistics invoice)",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Credit Note (Logistics invoice)/RE > Credit Note Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE",
"Purchase order/ZR > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase order/ZR > Invoice Receipt (Logistics invoice)/RE > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase order/ZR > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Clearing /KZ",
"Purchase requisition/NB", "Purchase requisition/NB > PR release - MRP / RFQ / purchase order",
"Purchase requisition/NB > PR release - RFQ / purchase order",
"Purchase requisition/NB > Purchase order/NB", "Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Posting (Account maintenance) > Invoice Receipt (Account maintenance)/AE",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Clearing /AB",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Clearing /ZA",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice)",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /AB",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /AB > Credit Note (Logistics invoice, cancel)/RE > Invoice Receipt (Logistics invoice)/RE > Credit Note Posting (Logistics invoice, cancel) > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /AB > Credit Note (Logistics invoice, cancel)/RE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Credit Note Posting (Logistics invoice, cancel) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /ZA",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /ZA",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice)",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/RE > Invoice Posting (Logistics invoice) > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/ZI > Invoice Posting (Logistics invoice) > Clearing /AB",
"Purchase requisition/NB > Purchase order/NB > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE",
"Purchase requisition/NB > Purchase order/NB > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Clearing /AB",
"Purchase requisition/NB > Purchase order/NB > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Clearing /KZ",
"Purchase requisition/NB > Purchase order/NB > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/RE > Clearing /ZA",
"Purchase requisition/NB > Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/IE",
"Purchase requisition/NB > Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Goods Receipt/WE > Invoice Posting (Logistics invoice) > Invoice Receipt (Logistics invoice)/IE > Clearing /ZA",
"Purchase requisition/NB > Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE",
"Purchase requisition/NB > Purchase order/ZB > Delivery (Stock Transfer) > Goods Issue for Stock Transfer > Invoice Posting (Logistics invoice) > Goods Receipt/WE > Invoice Receipt (Logistics invoice)/IE > Clearing /ZA",
"Purchase requisition/RV")