CSV importer problem behaviour with investment transactions

wgking · October 5, 2024, 11:02pm

I am running KMyMoney Version 5.1.3-fc8f557ef on Kubuntu 22.04

I have a problem importing some investment transactions using the CSV importer. I have massaged the CSV file downloaded from my broker to a format that is acceptable to KMM, and setup the broker templates to process the files. It mostly works except for the case where there are multiple “Dividend” transactions on the same date in the import file. When that happens the importer sets the security to the last one being imported. There may be other instances where this happens as well, but this is the one I noticed. Here is a sample CSV file with 3 dividend transactions and the resulting imported transaction screenshot in KMM.

wgking@KDEKMM2022:/tmp$ cat PP_9_31LF58J-activity-05-Oct-2024.csv
2024-10-01,2024-09-30,TDB Investment Savings,DivReInv,4.60700000000000000,10,,46.07,TDB8150
2024-09-27,2024-09-27,iShared CDN select dividend,Dividend,0,0,,308.41,TSE:XDV
2024-09-27,2024-09-27,iShares 1-5 yr Corp Bond,Dividend,0,0,,96.25,TSE:CBO
2024-09-27,2024-09-27,iShares Core Equity,Dividend,0,0,,73.32,TSE:XEQT

In KMM the transactions become:

I can go in afterwards and correct the security name based on the amounts in the transactions so the securities are valid KMM holdings.

It looks like the CSV importer creates an intermediate XML file, and the error happens with that file creation. XML file resulting from the the CSV imported looks like this:

<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE KMYMONEY-STATEMENT>
<KMYMONEY-STATEMENT>
 <STATEMENT version="1.1" currency="" type="investment" enddate="" closingbalance="-9223372036854775807/100" routingnumber="" accountid="" accountname="" skipCategoryMatching="0" accountnumber="" begindate="">
  <TRANSACTION bankid="" action="reinvestdividend" payee="" amount="4607/100" reconcile="0" memo="" dateposted="2024-10-01" number="" security="TDB Investment Savings" shares="4607/1000" brokerageaccount=""/>
  <TRANSACTION bankid="" action="cashdividend" payee="" amount="30841/100" reconcile="0" memo="" dateposted="2024-09-27" number="" security="iShares Core Equity" shares="0/1" brokerageaccount=""/>
  <TRANSACTION bankid="" action="cashdividend" payee="" amount="385/4" reconcile="0" memo="" dateposted="2024-09-27" number="" security="iShares Core Equity" shares="0/1" brokerageaccount=""/>
  <TRANSACTION bankid="" action="cashdividend" payee="" amount="1833/25" reconcile="0" memo="" dateposted="2024-09-27" number="" security="iShares Core Equity" shares="0/1" brokerageaccount=""/>
  <SECURITY name="iShares Core Equity" symbol="2024-09-27" id=""/>
  <SECURITY name="TDB Investment Savings" symbol="2024-09-30" id=""/>
 </STATEMENT>
</KMYMONEY-STATEMENT>

This does not seem to happen if the transaction is “interest” instead of “Dividend”.

This looks like a bug in the CSV importer.

I could massage all the “Dividend” transactions to be “Interest”, but that seems like a kludge. Other ideas welcome.

ostroffjh · October 5, 2024, 11:48pm

I’ll have to play with this data, but you might possibly have found a bug in the CSV importer. The version number you list suggests you are using a Stable Appimage compiled from the 5.1 branch. Is it possible for you to test with a Development Appimage compiled from mater branch? I ask because there have likely been some changes to the csv importer made in master branch and not in the stable 5.1 branch.

That kmm-…xml is indeed an intermediate “statement” file, produced by all the importers. which are all then actually imported by the same code.

wgking · October 6, 2024, 1:22am

Thanks for the feedback.

I download the latest dev version, reran the CSV import., and got the same result.

KMyMoney Version 5.1.80-91cc03d

CSVimporter intermediate file:

<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE KMYMONEY-STATEMENT>
<KMYMONEY-STATEMENT>
 <STATEMENT begindate="" accountnumber="" enddate="" skipCategoryMatching="0" version="1.1" currency="" accountname="" type="investment" accountid="" routingnumber="" closingbalance="-9223372036854775807/100">
  <TRANSACTION amount="4607/100" reconcile="0" shares="4607/1000" brokerageaccount="" number="" bankid="" dateposted="2024-10-01" action="reinvestdividend" security="TDB Investment Savings" securityId="" payee="" memo=""/>
  <TRANSACTION amount="30841/100" reconcile="0" shares="0/1" brokerageaccount="" number="" bankid="" dateposted="2024-09-27" action="cashdividend" security="iShares Core Equity" securityId="" payee="" memo=""/>
  <TRANSACTION amount="385/4" reconcile="0" shares="0/1" brokerageaccount="" number="" bankid="" dateposted="2024-09-27" action="cashdividend" security="iShares Core Equity" securityId="" payee="" memo=""/>
  <TRANSACTION amount="1833/25" reconcile="0" shares="0/1" brokerageaccount="" number="" bankid="" dateposted="2024-09-27" action="cashdividend" security="iShares Core Equity" securityId="" payee="" memo=""/>
  <SECURITY smallestFraction="100/1" symbol="2024-09-27" id="" name="iShares Core Equity"/>
  <SECURITY smallestFraction="100/1" symbol="2024-09-30" id="" name="TDB Investment Savings"/>
 </STATEMENT>
</KMYMONEY-STATEMENT>

KMM after import:

Looks like the same behaviour.

ostroffjh · October 6, 2024, 1:52am

I am unable to replicate this, using 5.1.3 (compiled from release tarball.) I created new investment and brokerage accounts, copied your csv lines into a csv file, and imported. I had to provide names for the four symbols, and tell it what activity DivReInv was, but it imported each transaction to the correct/different security.
I’ll have to retry with an Appimage version to see if perhaps there is a regression, but I don’t think it is likely.
Can you create a minimal kmy file (only the investment and brokerage accounts) to replicate this? That would make tracking down the problem easier.

wgking · October 6, 2024, 2:57am

Ok. Stay tuned.

ostroffjh · October 6, 2024, 3:05am

One question - where did you find that intermediate statement xml file? I know where they get created when I do direct connect OFX imports, but I can’t find one after these csv imports (and I get the same results with git head 5.1 and master.)
I’m wondering if some kind of matching is going on - try launching KMyMoney in a terminal and see if there is anything helpful in the console output. I’ll do the same and perhaps we can find some relevant difference.

wgking · October 6, 2024, 11:07pm

I stumbled across the intermediate file in /tmp which is where the CSV import files were also stored. A new kmm-statement* file was created for each CSV file imported like below:

wgking@KDEKMM2022:/tmp$ ls -tl
total 72
-rw-rw-r-- 1 wgking wgking 1267 Oct  6 16:45 'kmm-statement-2024-10-06 22-45-26.736.txt'
-rw-rw-r-- 1 wgking wgking  317 Oct  6 16:44  tfsa-import.csv
-rw-rw-r-- 1 wgking wgking  383 Oct  6 16:43  KMM-problem-csv.txt
drwx------ 2 wgking wgking 4096 Oct  6 16:36  plasma-csd-generator.ORfitQ
-rw------- 1 wgking wgking  422 Oct  6 16:36  ksmserver.oGHvep
-rw------- 1 wgking wgking   55 Oct  6 16:36  xauth-1000-_0

I started KMM manually and captured s`tdout as follows:

wgking@KDEKMM2022:~/Downloads$ ./kmymoney-5.1-348-linux-gcc-x86_64.AppImage
AppImageInfo: "/tmp/.mount_kmymon5SrW64/AppRun.wrapped" "/tmp/.mount_kmymon5SrW64/" "AppRun.wrapped"
LD_LIBRARY_PATH set to "/tmp/.mount_kmymon5SrW64/usr/lib:/tmp/.mount_kmymon5SrW64/usr/lib/:"
QPainter::begin: Paint device returned engine == 0, type: 2
WebConnect: Try to connect to WebConnect server
WebConnect: Connect to server failed
WebConnect: Running in server mode
Found an 'html' folder with CSS files: "/tmp/.mount_kmymon5SrW64/usr/bin/../share/kmymoney/html/"
System icon theme as reported by QT:  "breeze"
QPainter::begin: Paint device returned engine == 0, type: 2
QPainter::begin: Paint device returned engine == 0, type: 2
kf.xmlgui: Shortcut for action  "transaction_assign_number" "Assign next number" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "transaction_select_all" "Select all" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "transaction_mark_reconciled" "Reconciled" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "transaction_mark_cleared" "Cleared" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "transaction_mark_toggle" "Toggle" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "transaction_new" "New" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "account_reconcile" "Reconcile..." set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "view_show_all_accounts" "Show all accounts" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "view_hide_unused_categories" "Hide unused categories" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "view_hide_reconciled_transactions" "Hide reconciled transactions" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "view_show_transaction_detail" "Show Transaction Detail" set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
kf.xmlgui: Shortcut for action  "edit_find_transaction" "Find transaction..." set with QAction::setShortcut()! Use KActionCollection::setDefaultShortcut(s) instead.
QFSFileEngine::open: No file name specified
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/budgetview.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/checkprinting.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/csvexporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/csvimporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/forecastview.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/gncimporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/icalendarexporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kbanking.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kcm_checkprinting.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kcm_csvimporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kcm_forecastview.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kcm_icalendarexporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kcm_qif.so" Validity false
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kcm_reportsview.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kcm_xmlstorage.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/konlinetasks_sepa.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/ofximporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/onlinejoboutboxview.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/qifexporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/qifimporter.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/reconciliationreport.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/reportsview.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/sqlstorage.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/woob.so" Validity true
Located plugin "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/xmlstorage.so" Validity true
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/budgetview.so"
Plugins: budgetview loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/checkprinting.so"
Plugins: checkprinting loaded
QFSFileEngine::open: No file name specified
QIODevice::read (QFile, ""): device not open
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/csvexporter.so"
Plugins: csvexporter loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/csvimporter.so"
Plugins: csvimporter loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/forecastview.so"
Plugins: forecastview loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/gncimporter.so"
Plugins: gncimporter loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/icalendarexporter.so"
Plugins: icalendarexporter loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/kbanking.so"
"Plugins: kbanking loaded, build with (5.8.1stable-0/6.4.1.0stable), run with (5.8.1.0/6.4.1.0)"
3:2024/10/06 16-39-21:(null)(1917):/home/appimage/Craft/BinaryFactory/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.4.1/src/libs/aqbanking/banking_update.c:  610: No AqBanking config folder found at [/home/wgking/.aqbanking/settings6/users] (-1)
3:2024/10/06 16-39-21:(null)(1917):/home/appimage/Craft/BinaryFactory/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.4.1/src/libs/aqbanking/banking_update.c:  610: No AqBanking config folder found at [/home/wgking/.aqbanking/settings/users] (-1)
3:2024/10/06 16-39-21:(null)(1917):/home/appimage/Craft/BinaryFactory/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.4.1/src/libs/aqbanking/banking_update.c:  411: There is no old settings folder, need initial setup
7:2024-10-06 16:39:21:aqbanking started
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/ofximporter.so"
Plugins: ofximporter loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/onlinejoboutboxview.so"
Plugins: onlinejoboutboxview loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/qifexporter.so"
Plugins: qifexporter loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/qifimporter.so"
Plugins: qifimporter loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/reconciliationreport.so"
Plugins: reconciliation report loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/reportsview.so"
Plugins: reportsview loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/sqlstorage.so"
Plugins: sqlstorage loaded
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/woob.so"
Could not load plugin '/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/woob.so', error: Cannot load library /tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/woob.so: (libpython3.6m.so.1.0: cannot open shared object file: No such file or directory)
Loading "/tmp/.mount_kmymon5SrW64/usr/plugins/kmymoney/xmlstorage.so"
Plugins: xmlstorage loaded
Found an 'html' folder with CSS files: "/tmp/.mount_kmymon5SrW64/usr/bin/../share/kmymoney/html/"
reading file
start parsing file
startDocument
reading securities
endDocument
testing fileFixVersion 0 < 5
void KMyMoneyApp::Private::fixSchedule_0(MyMoneySchedule)   "SCH000001"   "S0001"  should be 'not reconciled'
void KMyMoneyApp::Private::fixSchedule_0(MyMoneySchedule)   "SCH000003"   "S0001"  should be 'not reconciled'
void KMyMoneyApp::Private::fixSchedule_0(MyMoneySchedule)   "SCH000004"   "S0001"  should be 'not reconciled'
void KMyMoneyApp::Private::fixSchedule_0(MyMoneySchedule)   "SCH000005"   "S0001"  should be 'not reconciled'
void KMyMoneyApp::Private::fixSchedule_0(MyMoneySchedule)   ""  has no commodity
testing fileFixVersion 1 < 5
testing fileFixVersion 2 < 5
405 transactions fixed in fixFile_2
testing fileFixVersion 3 < 5
testing fileFixVersion 4 < 5
Cost center model created with items 0
Payees model created with items 0
----End startup

I also captured stdout during a problem CSV import as follows:

---Start CSV Import
KMyMoneyPlugin::KMMStatementInterface::import start
Importing statement for 'TD TFSA'
Found  "iShares Core Equity"  with id  "E000103"
Found  "TDB investment savings"  with id  "E000043"
Processing transactions (TD TFSA)
Process on: '2024-10-01', id: '', symbol: '2024-09-30', amount: '46.07', fees: '0.00'
Looking for a match with transaction:  "2024-10-01" , "" , "4.60" (referenced account:  "TDB Investment Savings" )
Considering 0 existing transaction(s) for matching
Looking for a match with transaction:  "2024-10-01" , "" , "4.60" (referenced account:  "TDB Investment Savings" )
Considering 0 schedule(s) for matching the transaction
Process on: '2024-09-27', id: '', symbol: '2024-09-27', amount: '308.41', fees: '0.00'
Looking for a match with transaction:  "2024-09-27" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 existing transaction(s) for matching
Looking for a match with transaction:  "2024-09-27" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 schedule(s) for matching the transaction
Process on: '2024-09-27', id: '', symbol: '2024-09-27', amount: '96.25', fees: '0.00'
Looking for a match with transaction:  "2024-09-27" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 1 existing transaction(s) for matching
Looking for a match with transaction:  "2024-09-27" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 schedule(s) for matching the transaction
Process on: '2024-09-27', id: '', symbol: '2024-09-27', amount: '73.32', fees: '0.00'
Looking for a match with transaction:  "2024-09-27" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 2 existing transaction(s) for matching
Looking for a match with transaction:  "2024-09-27" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 schedule(s) for matching the transaction
Processing transactions done (TD TFSA)
Importing statement for 'TD TFSA' done

--End import

I hope this helps.

I will now create an empty KMM database with just those securities and try an import to it.

wgking · October 7, 2024, 4:31am

Ok, been a while since I setup a new instance of KMM, but after doing so with 1 investment account the import problem still persists. I had to tweak the dates on the imported transactions since I setup the investments as of October 1.

I ran both the current and dev versions of KMM and got the same result.

CSV file now looks like:

wgking@KDEKMM2022:/tmp$ cat tfsa-import-new.csv
2024-10-03,2024-10-02,TDB Investment Savings,DivReInv,4.607,10,,46.07,TDB8150
2024-10-04,2024-10-03,iShared CDN select dividend,Dividend,0,0,,308.41,TSE:XDV
2024-10-04,2024-10-03,iShares 1-5 yr Corp Bond,Dividend,0,0,,96.25,TSE:CBO
2024-10-04,2024-10-03,iShares Core Equity,Dividend,0,0,,73.32,TSE:XEQT

stdout forKJMM startup and import looks like:

wgking@KDEKMM2022:/tmp$ ./kmymoney-master-3552-linux-gcc-x86_64.AppImage
Alkimia: static void AlkEnvironment::checkForAppImageEnvironment(const char*) AppImageInfo: "/tmp/.mount_kmymonFCWgR5/AppRun.wrapped" "/tmp/.mount_kmymonFCWgR5/" "AppRun.wrapped"
Alkimia: static void AlkEnvironment::checkForAppImageEnvironment(const char*) LD_LIBRARY_PATH set to "/tmp/.mount_kmymonFCWgR5/usr/lib"
Model for "ST" loaded with 4 items in 0 ms
Monetary values will be formatted based on locale "en_CA" Example:  "$123.45"
Long date format "dddd, MMMM d, yyyy"
Short date format "yyyy-MM-dd"
Narrow date format "yyyy-MM-dd"
WebConnect: Try to connect to WebConnect server
WebConnect: Connect to server failed
WebConnect: Running in server mode
System icon theme as reported by QT:  "breeze"
App icon theme as configured in KMyMoney:  "system"
Obeying the system-wide icon theme, currently set to:  "breeze"
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/budgetview.so"
Plugins: budgetview loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/checkprinting.so"
Plugins: checkprinting loaded
Template successfully opened from ":/plugins/checkprinting/templates/check_template.html"
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/csvexporter.so"
Plugins: csvexporter loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/csvimporter.so"
Plugins: csvimporter loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/forecastview.so"
Plugins: forecastview loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/gncimporter.so"
Plugins: gncimporter loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/icalendarexporter.so"
Plugins: icalendarexporter loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/kbanking.so"
"Plugins: kbanking loaded, build with (5.11.2beta-0/6.5.12.0beta), run with (5.11.2.0/6.5.12.0)"
Set loglevel for gwenhywfar to verbose
Set loglevel for aqbanking to verbose
Set loglevel for aqhbci to verbose
6:2024/10/06 22-20-01:(null)(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.5.12beta/src/libs/aqbanking/banking.c:   99: Application "KMyMoney" compiled with extensions 00000000
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking/settings6"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking/settings6" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking/settings6
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking/settings6/users"
7:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  135: stat: No such file or directory (/home/wgking/.aqbanking/settings6/users)
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  139: Path "/home/wgking/.aqbanking/settings6/users" does not exist (it should)
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  249: Path so far: "/home/wgking/.aqbanking/settings6/users"
3:2024/10/06 22-20-01:(null)(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.5.12beta/src/libs/aqbanking/banking_update.c:  610: No AqBanking config folder found at [/home/wgking/.aqbanking/settings6/users] (-1)
6:2024/10/06 22-20-01:(null)(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.5.12beta/src/libs/aqbanking/banking_update.c:  379: No current settings folder, trying to copy old one
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking/settings"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking/settings" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking/settings
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking/settings/users"
7:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  135: stat: No such file or directory (/home/wgking/.aqbanking/settings/users)
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  139: Path "/home/wgking/.aqbanking/settings/users" does not exist (it should)
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  249: Path so far: "/home/wgking/.aqbanking/settings/users"
3:2024/10/06 22-20-01:(null)(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.5.12beta/src/libs/aqbanking/banking_update.c:  610: No AqBanking config folder found at [/home/wgking/.aqbanking/settings/users] (-1)
3:2024/10/06 22-20-01:(null)(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.5.12beta/src/libs/aqbanking/banking_update.c:  411: There is no old settings folder, need initial setup
6:2024/10/06 22-20-01:(null)(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.5.12beta/src/libs/aqbanking/banking_cfg.c:   82: Using data folder [/home/wgking/.aqbanking]
6:2024/10/06 22-20-01:(null)(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/aqbanking/work/aqbanking-6.5.12beta/src/libs/aqbanking/banking_cfg.c:   85: Using ConfigManager [dir:///home/wgking/.aqbanking/settings6]
7:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/parser/urlfns.c:  176: Path: [/home/wgking/.aqbanking/settings6]
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/plugin.c:  532: Trying to load plugin "dir"
7:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/posix/libloader.c:   86: Loading library "/tmp/.mount_kmymonFCWgR5/usr/lib/gwenhywfar/plugins/79/configmgr/dir"
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/posix/libloader.c:  107: dlopen(/tmp/.mount_kmymonFCWgR5/usr/lib/gwenhywfar/plugins/79/configmgr/dir): /tmp/.mount_kmymonFCWgR5/usr/lib/gwenhywfar/plugins/79/configmgr/dir: cannot open shared object
7:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/posix/libloader.c:   86: Loading library "/tmp/.mount_kmymonFCWgR5/usr/lib/gwenhywfar/plugins/79/configmgr/dir.so"
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/posix/libloader.c:  127: Loaded library "/tmp/.mount_kmymonFCWgR5/usr/lib/gwenhywfar/plugins/79/configmgr/dir.so"
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/posix/libloader.c:  242: Library "/tmp/.mount_kmymonFCWgR5/usr/lib/gwenhywfar/plugins/79/configmgr/dir.so" loaded
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/posix/libloader.c:  167: Resolved symbol "configmgr_dir_factory": 0x7f8aa5007d40
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/plugin.c:  536: Plugin "dir" loaded and added to internal list
7:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/parser/urlfns.c:  176: Path: [/home/wgking/.aqbanking/settings6]
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/gui/gui_dialogs.c:   32: Using own callbacks in gui 0x2992ff0
6:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/gui/gui_dialogs.c:   32: Using own callbacks in gui 0x2992ff0
7:2024-10-06 22:20:01:aqbanking started
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  213: Adding path [/tmp/.mount_kmymonFCWgR5/usr/share/locale]
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  213: Adding path [/tmp/.mount_kmymonFCWgR5/usr/etc]
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  213: Adding path [/tmp/.mount_kmymonFCWgR5/usr/share]
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  213: Adding path [/tmp/.mount_kmymonFCWgR5/usr/lib/aqbanking/plugins/44/wizards]
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/plugin.c:  584: Plugin type "bankinfo" registered
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  213: Adding path [/tmp/.mount_kmymonFCWgR5/usr/lib/aqbanking/plugins/44/bankinfo]
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/plugin.c:  584: Plugin type "provider" registered
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  213: Adding path [/tmp/.mount_kmymonFCWgR5/usr/lib/aqbanking/plugins/44/providers]
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/plugin.c:  584: Plugin type "imexporter" registered
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  213: Adding path [/tmp/.mount_kmymonFCWgR5/usr/lib/aqbanking/plugins/44/imexporters]
6:2024-10-06 22:20:01:gwenhywfar /builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/base/pathmanager.c:  342: Adding path [/tmp/.mount_kmymonFCWgR5/usr/lib/aqbanking/plugins/44/dbio]
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking/settings6"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking/settings6" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking/settings6
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking/settings6/aqbanking"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking/settings6/aqbanking" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking/settings6/aqbanking
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  132: Checking path "/home/wgking/.aqbanking/settings6/aqbanking/config.conf"
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  145: Checking for type
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  228: Entry "/home/wgking/.aqbanking/settings6/aqbanking/config.conf" exists
8:2024/10/06 22-20-01:gwen(4864):/builds/sysadmin/ci-management/linux-64-gcc/build/libs/gwenhywfar/work/gwenhywfar-5.11.2beta/src/os/directory_all.c:  230: Returning this: /home/wgking/.aqbanking/settings6/aqbanking/config.conf
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/ofximporter.so"
Plugins: ofximporter loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/onlinejoboutboxview.so"
Plugins: onlinejoboutboxview loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/qifexporter.so"
Plugins: qifexporter loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/qifimporter.so"
Plugins: qifimporter loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/reconciliationreport.so"
Plugins: reconciliation report loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/reportsview.so"
Plugins: reportsview loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/sqlstorage.so"
Plugins: sqlstorage loaded
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/woob.so"
kf.coreaddons: "Could not load plugin from /tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/woob.so: Cannot load library /tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/woob.so: (libpython3.11.so.1.0: cannot open shared object file: No such file or directory)"
Could not load plugin '/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/woob.so', error: Could not load plugin from /tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/woob.so: Cannot load library /tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/woob.so: (libpython3.11.so.1.0: cannot open shared object file: No such file or directory)
Loading "/tmp/.mount_kmymonFCWgR5/usr/plugins/kmymoney_plugins/xmlstorage.so"
Plugins: xmlstorage loaded
Template successfully opened from ":/plugins/checkprinting/templates/check_template.html"
Open file QUrl("file:///home/wgking/KMM-Basic.kmy")
Model for "I" loaded with 2 items in 0 ms
Start verifying account hierarchy
End verifying account hierarchy
Model for accounts loaded with 18 items in 0 ms
Model for "T" loaded with 12 items in 0 ms
Model for parameters loaded with 3 items
Model for "E" loaded with 4 items in 0 ms
Model for currencies loaded with 1 items
Model for prices loaded with 5 items in 0 ms
Start calculating balances: 12 splits
End calculating balances
Model for "T" loaded with 1 items in 0 ms
current selection
Institutions: ("I000001")
Accounts: ("A000006")
JournalEntries: ("2024-10-01-T000000000000000006-S0002")
KMyMoneyPlugin::KMMStatementInterface::import start
Importing statement for 'TD TFSA'
Found  "TDB Investment Savings"  with id  "E000001"
Found  "iShares Core Equity"  with id  "E000004"
Processing transactions (TD TFSA)
Process on: '2024-10-03', id: '', symbol: '2024-10-02', amount: '46.07', fees: '0.00'
Looking for a match with transaction:  "2024-10-03" , "" , "4.60" (referenced account:  "TDB Investment Savings" )
Considering 0 existing transaction(s) for matching
Looking for a match with transaction:  "2024-10-03" , "" , "4.60" (referenced account:  "TDB Investment Savings" )
Considering 0 schedule(s) for matching the transaction
Process on: '2024-10-04', id: '', symbol: '2024-10-03', amount: '308.41', fees: '0.00'
Looking for a match with transaction:  "2024-10-04" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 existing transaction(s) for matching
Looking for a match with transaction:  "2024-10-04" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 schedule(s) for matching the transaction
Process on: '2024-10-04', id: '', symbol: '2024-10-03', amount: '96.25', fees: '0.00'
Looking for a match with transaction:  "2024-10-04" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 1 existing transaction(s) for matching
Looking for a match with transaction:  "2024-10-04" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 schedule(s) for matching the transaction
Process on: '2024-10-04', id: '', symbol: '2024-10-03', amount: '73.32', fees: '0.00'
Looking for a match with transaction:  "2024-10-04" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 2 existing transaction(s) for matching
Looking for a match with transaction:  "2024-10-04" , "" , "0.00" (referenced account:  "iShares Core Equity" )
Considering 0 schedule(s) for matching the transaction
Processing transactions done (TD TFSA)
Importing statement for 'TD TFSA' done
current selection
Institutions: ("I000001")
Accounts: ("A000006")
JournalEntries: ("2024-10-03-T000000000000000007-S0002")
current selection
Institutions: ("I000001")
Accounts: ("A000006")
JournalEntries: ("2024-10-03-T000000000000000007-S0001")
current selection
Institutions: ("I000001")
Accounts: ("A000006")
JournalEntries: ("2024-10-04-T000000000000000008-S0003")

Screenshot of ledger after import:

Since the issue appears in the intermediate XML file, it must be somewhere in the csvimporter utility.

Ideas welcome.

Greg

wgking · October 7, 2024, 5:54pm

I also did a test with the action set to “interest” and got the same result, so it is not just dividend transactions that are affected.

Not sure if it matters but my .config/kmymoney/csvimporterrc file is:

[Bank-BMO US Brokerage]
AmountCol=8
AutoAccountName=false
BalanceCol=-1
CategoryCol=2
CreditCol=-1
CreditDebitIndicatorCol=-1
CreditIndicator=
DateCol=1
DateFormat=0
DebitCol=-1
DebitIndicator=
DecimalSymbol=2
Directory=/tmp
Encoding=106
FieldDelimiter=0
MemoCol=3
NumberCol=-1
OppositeSigns=false
PayeeCol=4
StartLine=9
TextDelimiter=0
TrailerLines=0

[Bank-eqbank]
AmountCol=2
AutoAccountName=false
BalanceCol=-1
CategoryCol=1
CreditCol=-1
CreditDebitIndicatorCol=-1
CreditIndicator=
DateCol=0
DateFormat=2
DebitCol=-1
DebitIndicator=
DecimalSymbol=2
Directory=/tmp
Encoding=106
FieldDelimiter=0
MemoCol=
NumberCol=3
OppositeSigns=false
PayeeCol=-1
StartLine=1
TextDelimiter=0
TrailerLines=12

[Bank-testbank]
AmountCol=11
AutoAccountName=false
BalanceCol=-1
CategoryCol=-1
CreditCol=-1
CreditDebitIndicatorCol=-1
CreditIndicator=
DateCol=5
DateFormat=2
DebitCol=-1
DebitIndicator=
DecimalSymbol=1
Directory=~/Downloads
Encoding=106
FieldDelimiter=1
MemoCol=10
NumberCol=-1
OppositeSigns=false
PayeeCol=6
StartLine=1
TextDelimiter=0
TrailerLines=0

[Invest-BMO-template]
AmountCol=8
AutoAccountName=false
BuyParam=buy,Buy
DateCol=1
DateFormat=0
DecimalSymbol=2
Directory=/tmp
DivXParam=dividend,Dividend
DontAsk=0
Encoding=106
FeeCol=-1
FeeIsPercentage=true
FeeRate=
FieldDelimiter=0
IntIncParam=interest,income,Interest
MemoCol=
MinFee=
NameCol=3
PriceCol=6
PriceFraction=2
QuantityCol=5
ReinvdivParam=reinvest,reinv,re-inv,DivReInv
SecurityName=
SecuritySymbol=
SellParam=sell,repurchase
ShrsinParam=add,stock dividend,divd reinv,transfer in,re-registration in,journal entry
ShrsoutParam=remove
StartLine=9
SymbolCol=4
TextDelimiter=0
TrailerLines=0
TypeCol=2

[Invest-RBC-template]
AmountCol=8
AutoAccountName=false
BuyParam=buy
DateCol=6
DateFormat=0
DecimalSymbol=2
Directory=/tmp
DivXParam=dividend
DontAsk=0
Encoding=106
FeeCol=-1
FeeIsPercentage=false
FeeRate=
FieldDelimiter=0
IntIncParam=interest,income
MemoCol=10
MinFee=
NameCol=3
PriceCol=5
PriceFraction=2
QuantityCol=4
ReinvdivParam=reinvest,reinv,re-inv,DivReInv
SecurityName=
SecuritySymbol=
SellParam=sell,repurchase
ShrsinParam=add,stock dividend,divd reinv,transfer in,re-registration in,journal entry
ShrsoutParam=remove
StartLine=3
SymbolCol=2
TextDelimiter=0
TrailerLines=0
TypeCol=1

[Invest-TD-template]
AmountCol=7
AutoAccountName=false
BuyParam=buy
DateCol=0
DateFormat=0
DecimalSymbol=2
Directory=/tmp
DivXParam=dividend
DontAsk=0
Encoding=106
FeeCol=6
FeeIsPercentage=false
FeeRate=
FieldDelimiter=0
IntIncParam=interest,income
MemoCol=
MinFee=
NameCol=2
PriceCol=5
PriceFraction=2
QuantityCol=4
ReinvdivParam=reinvest,reinv,re-inv,DivReInv
SecurityName=
SecuritySymbol=
SellParam=sell,repurchase
ShrsinParam=add,stock dividend,divd reinv,transfer in,re-registration in,journal entry
ShrsoutParam=remove
StartLine=0
SymbolCol=1
TextDelimiter=0
TrailerLines=0
TypeCol=3

[Misc]
Height=426
KMMVer=5,0,0
QifExportProfile=Default
Width=800

[ProfileNames]
Bank=eqbank,testbank,BMO US Brokerage
CPrices=
Invest=BMO-template,TD-template,RBC-template
PriorBank=2
PriorCPrices=0
PriorInvest=1
PriorSPrices=0
SPrices=

wgking · October 7, 2024, 8:35pm

I tweaked the input file to give each transaction its own date. Now the import works correctly and the intermediate file looks good. I used the dev KMM.

Input CSV:

wgking@KDEKMM2022:/tmp$ cat tfsa-test-import.csv
2024-10-07,2024-10-07,TDB Investment Savings,DivReInv,4.607,10,,46.07,TDB8150
2024-10-05,2024-10-04,iShared CDN select dividend,Dividend,0,0,,308.41,TSE:XDV
2024-10-06,2024-10-05,iShares 1-5 yr Corp Bond,Dividend,0,0,,96.25,TSE:CBO
2024-10-07,2024-10-06,iShares Core Equity,Dividend,0,0,,73.32,TSE:XEQT

Intermediate KMM file:

wgking@KDEKMM2022:/tmp$ cat kmm-statement-2024-10-07T20-26-03.477.txt
<?xml version="1.0" encoding="utf-8"?>
<!DOCTYPE KMYMONEY-STATEMENT>
<KMYMONEY-STATEMENT>
 <STATEMENT routingnumber="" accountid="" enddate="" accountname="" closingbalance="-9223372036854775807/100" currency="" begindate="" type="investment" version="1.1" accountnumber="" skipCategoryMatching="0">
  <TRANSACTION number="" dateposted="2024-10-07" securityId="" brokerageaccount="" bankid="" security="TDB Investment Savings" payee="" reconcile="0" action="reinvestdividend" memo="" amount="4607/100" shares="4607/1000"/>
  <TRANSACTION number="" dateposted="2024-10-05" securityId="" brokerageaccount="" bankid="" security="iShared CDN select dividend" payee="" reconcile="0" action="cashdividend" memo="" amount="30841/100" shares="0/1"/>
  <TRANSACTION number="" dateposted="2024-10-06" securityId="" brokerageaccount="" bankid="" security="iShares 1-5 yr Corp Bond" payee="" reconcile="0" action="cashdividend" memo="" amount="385/4" shares="0/1"/>
  <TRANSACTION number="" dateposted="2024-10-07" securityId="" brokerageaccount="" bankid="" security="iShares Core Equity" payee="" reconcile="0" action="cashdividend" memo="" amount="1833/25" shares="0/1"/>
  <SECURITY smallestFraction="100/1" symbol="2024-10-04" id="" name="iShared CDN select dividend"/>
  <SECURITY smallestFraction="100/1" symbol="2024-10-05" id="" name="iShares 1-5 yr Corp Bond"/>
  <SECURITY smallestFraction="100/1" symbol="2024-10-06" id="" name="iShares Core Equity"/>
  <SECURITY smallestFraction="100/1" symbol="2024-10-07" id="" name="TDB Investment Savings"/>
 </STATEMENT>
</KMYMONEY-STATEMENT>

KMM after import:

Sure looks like a csv importer issue.

ostroffjh · October 7, 2024, 10:31pm

I see one difference. You have:

but I get

In your case, it is only identifying two securities instead of all four. Then, instead of creating the two “missing” securities, it is importing those transactions to the existing security. (For further testing, you can drop the one csv line for the dividend reinvestment, as it always imports correctly.) Open the kmy file where you know it will import incorrectly, and go to the Investment View for the investment account. On the equities tab, how many rows are displayed?
For some reason, I think however you are initially creating the three iShares entries, only one is actually getting created correctly, so all three end up mapping to the one. I have no idea if it is because all three symbols start with “TSE:” perhaps the colon is causing the security symbol to be truncated?
The next step would be listing the actual EQUITY entries within the kmy file, but lets leave that for later.

wgking · October 8, 2024, 7:26pm

Securities seem to be registered correctly. If the csvimporter is triggering on a special character like “:” then I expect there would be lots of problems as that is a common stock exchange delimiter.

ostroffjh · October 9, 2024, 11:08pm

Actually, one more thing you can do to troubleshoot. If you start KMyMoney from command line, then when you do the import, it should output some details about what the importer is doing. Unfortunately, I’m not sure if the csvimporter is sufficiently verbose, and given that the issue appears to be there, the output of the routine which actually process that “statement” file is not likely to be helpful. You can look through the output to see if anything looks amiss, or post the relevant parts here.
Since I am not able to replicate the problem, it would really help if you could create a minimal .kmy file and .csv file which demonstrates the problem, without revealing any of your personal information.

wgking · October 9, 2024, 11:46pm

Thanks for your help. I did a test with securities without the “TSE:” prefix and the problem persists. I have created a minimal KMY database with just 4 holdings to play around with. Although they are real holdings, I don’t consider this minimal database to be much personal data. Test data and results are:

wgking@KDEKMM2022:/tmp$ cat tfsa-import-new.csv
2024-10-08,2024-10-08,iShares CDNSelect Dividend NEW,Dividend,0,0,,308.41,XDV
2024-10-08,2024-10-08,Ishares 1-5 yr Corp Bond NEW,Dividend,0,0,,96.25,CBO
2024-10-08,2024-10-08,iShares Core Equity NEW,Dividend,0,0,,73.32,XEQT

I am surprised that your attempts to replicate the problem have failed since I don’t think my configuration of KMY is special.

I have uploaded my basic KMY file to my Google drive where you should be able to replicate the problem using the import files and configuration files listed in this problem description. Link is: Basic KMY database

You may have to delete KMY records or change transaction dates to make the import work without duplicates.

Thanks again.

ostroffjh · October 11, 2024, 12:52am

The import works fine for me, and I’ve tried with both a recent 5.1 appimage as well as a version from master branch. I’m a bit stumped, but there are a few things we can still look at. What columns are you assigning for the import?

date could be 1 or 2, price and quantity could be switched, memo doesn’t matter. Looking at the csvimporterrc section for Invest-TD-template shows no column for security name or symbol. I wouldn’t think it would allow those to be blank/missing, but see if they are correctly set or not, and if that might solve the problem.

wgking · October 11, 2024, 4:24am

Thank you - you solved it! I had the symbol mapped to column 2 which does not make any sense, but when I map it to column 9 everything works. It is kinda weird that the import works when column 2 has different dates (and not valid symbols).

I don’t remember making that mapping so maybe it was for an earlier version of the massaged CSV file which I overlooked changing when I changed the layout, and it sort of worked sometimes…

Thanks again.

Greg