====== Panama Papers - Updated May 10th, 2016 version ======
An updated version of Panama Papers meta data appeared on May 10th, 2016 (May 13th, 2016 on files within the ZIP). I reran the above programs in it.
>>>
============= RESTART: C:\Users\batagelj\data\panama\nodeRead.py =============
nodeRead
started: Sat May 21 09:55:42 2016
type = 1 n = 319150
type = 2 n = 342786
*** Duplicated node 581202 51122
*** Duplicated node 581236 51149
*** Duplicated node 581250 51162
*** Duplicated node 581333 51224
...
*** Duplicated node 686948 70699
*** Duplicated node 687061 70785
*** Duplicated node 687173 70872
*** Duplicated node 687187 70884
type = 3 n = 687241
type = 4 n = 838295
finished: Sat May 21 09:56:02 2016
>>>
In the new version of the file **''all_edges.csv''** there are many more relations.
>>>
============= RESTART: C:\Users\batagelj\data\panama\linkRead.py =============
linkRead
started: Sat May 21 11:38:30 2016
n = 838295 m = 1269796
['node_1', 'rel_type', 'node_2']
1 "intermediary of"
2 "shareholder of"
3 "Shareholder of"
4 "Director / Shareholder of"
5 "Director of"
6 "Director (Rami Makhlouf) of"
7 "Power of Attorney of"
8 "Director / Shareholder / Beneficial Owner of"
...
81 "Nominee Trust Settlor of"
82 "Nominee Beneficiary of"
83 "Nominee Secretary of"
84 "Nominee Beneficial Owner of"
finished: Sat May 21 11:38:39 2016
>>>
============ RESTART: C:/Users/batagelj/data/panama/otherRead.py ============
otherRead
started: Sat May 21 12:03:11 2016
r = 1 n = 838295 m = 365643
r = 2 n = 838295 m = 22860
r = 3 n = 838295 m = 252197
r = 4 n = 838295 m = 150162
['address', 'icij_id', 'valid_until', 'country_codes', 'countries', 'node_id', 'sourceID']
1 838296 SAM
2 838297 HKG
3 838298 TWN
4 838299 CHN
5 838300 CHE
6 838301 SGP
7 838302 BRA
8 838303 PAN
...
235 838530 GNQ
236 838531 REU
237 838532 SMR
238 838533 KGZ
239 838534 TON
240 838535 BTN
finished: Sat May 21 12:03:27 2016
>>>
===== Inspection of Pajek files =====
==============================================================================
Info on Multiple Relations Network 1. C:\Users\batagelj\data\panama\pajek\panama.net (838295)
==============================================================================
Relation No. Arcs Edges Total Label
---------------------------------------------------------------
1 319039 0 319039 intermediary of
2 277380 0 277380 shareholder of
3 105408 0 105408 Shareholder of
4 6 0 6 Director / Shareholder of
5 118589 0 118589 Director of
6 2 0 2 Director (Rami Makhlouf) of
7 20 0 20 Power of Attorney of
8 2 0 2 Director / Shareholder / Beneficial Owner of
9 1 0 1 Member / Shareholder of
10 16 0 16 Owner of
11 1847 0 1847 Beneficial Owner of
12 9 0 9 Power of attorney of
13 28 0 28 Owner, director and shareholder of
14 1 0 1 President - Director of
15 4 0 4 Sole shareholder of
16 1 0 1 President and director of
17 4 0 4 Director / Beneficial Owner of
18 1 0 1 Power of Attorney / Shareholder of
19 1 0 1 Director and shareholder of
20 15151 0 15151 beneficiary of
21 40 0 40 President of
22 1 0 1 Authorized signatory of
23 14351 0 14351 Secretary of
24 3 0 3 Member of Foundation Council of
25 2 0 2 Signatory of
26 1 0 1 Grantee of a mortgage of
27 25 0 25 Beneficial owner of
28 2 0 2 Sole signatory of
29 1 0 1 Sole signatory / Beneficial owner of
30 3 0 3 Principal beneficiary of
31 1198 0 1198 Protector of
32 6 0 6 Beneficiary, shareholder and director of
33 4031 0 4031 Beneficiary of
34 3 0 3 Connected of
35 1 0 1 Shareholder (through Julex Foundation) of
36 1 0 1 First beneficiary of
37 1229 0 1229 Authorised Person / Signatory of
38 320 0 320 Co-Trustee of Trust of
39 7 0 7 Partner of
40 1234 0 1234 Trust Settlor of
41 281 0 281 Officer of
42 120 0 120 General Accountant of
43 13 0 13 Successor Protector of
44 41 0 41 Register of Shareholder of
45 74 0 74 Reserve Director of
46 207 0 207 Auditor of
47 65 0 65 Investment Advisor of
48 272 0 272 Resident Director of
49 409 0 409 Alternate Director of
50 101 0 101 Nominated Person of
51 48 0 48 Register of Director of
52 14 0 14 Tax Advisor of
53 123 0 123 Bank Signatory of
54 1418 0 1418 Trustee of Trust of
55 32 0 32 Appointor of
56 89 0 89 Legal Advisor of
57 9 0 9 Personal Directorship of
58 11 0 11 Stockbroker of
59 41 0 41 Joint Settlor of
60 583 0 583 Assistant Secretary of
61 18 0 18 Unit Trust Register of
62 18 0 18 Treasurer of
63 7 0 7 Vice President of
64 32 0 32 Auth. Representative of
65 36318 0 36318 Records & Registers of
66 8 0 8 Safekeeping of
67 173 0 173 Correspondent Addr. of
68 4 0 4 Chairman of
69 2 0 2 Board Representative of
70 14 0 14 Custodian of
71 1 0 1 Nominee Name of
72 316472 0 316472 registered address
73 622 0 622 related entity
74 46761 0 46761 similar name and address as
75 3146 0 3146 same name and registration date as
76 960 0 960 same address as
77 1130 0 1130 Nominee Shareholder of
78 64 0 64 Nominee Director of
79 8 0 8 Nominee Protector of
80 1 0 1 Nominee Investment Advisor of
81 24 0 24 Nominee Trust Settlor of
82 2 0 2 Nominee Beneficiary of
83 5 0 5 Nominee Secretary of
84 4 0 4 Nominee Beneficial Owner of
---------------------------------------------------------------
==============================================================================
Info on Multiple Relations Network 2. C:\Users\batagelj\data\panama\pajek\countries.net [2-Mode] (838535)
==============================================================================
Relation No. Arcs Edges Total Label
---------------------------------------------------------------
1 365643 0 365643 entities
2 22860 0 22860 intermediaries
3 252197 0 252197 officers
4 150162 0 150162 addresses
---------------------------------------------------------------
===== Countries =====
If we look at the list of countries we notice that some countries appear under different codes. To identify such duplicates we order the list in alphabetic order:
107 ABW - Aruba
164 AGO - Angola
100 AIA - Anguilla
171 ALB - Albania
15 AND - Andorra
95 ANG - British Anguilla
22 ARE - United Arab Emirates
72 ARG - Argentina
216 ARM - Armenia
75 ASM - American Samoa
118 ATG - Antigua and Barbuda
70 AUS - Australia
74 AUT - Austria
142 AZE - Azerbaijan
168 BAH - Bahamas
18 BEL - Belgium
225 BEN - Benin
187 BERMU - Bermuda
207 BFA - Burkina Faso
165 BGD - Bangladesh
108 BGR - Bulgaria
139 BHR - Bahrain
31 BHS - Bahamas
228 BIH - Bosnia and Herzegovina
134 BLR - Belarus
33 BLZ - Belize
68 BMU - Bermuda
104 BOL - Bolivia, Plurinational State of
7 BRA - Brazil
136 BRB - Barbados
167 BRN - Brunei Darussalam
188 BRUN - Brunei
240 BTN - Bhutan
137 BVI - British Virgin Islands
126 BWA - Botswana
166 CAF - Central African Republic
61 CAN - Canada
176 CAYMN - Cayman
5 CHE - Switzerland
190 CHINA - China
77 CHL - Chile
4 CHN - China
56 CIV - Côte d'Ivoire
172 CMR - Cameroon
210 COD - Congo, the Democratic Republic of the
130 COK - Cook Islands
13 COL - Colombia
186 COOK - Cook Islands
208 CPV - Cape Verde
50 CRI - Costa Rica
127 CUB - Cuba
119 CUW - Curaçao
52 CYM - Cayman Islands
23 CYP - Cyprus
46 CZE - Czech Republic
38 DEU - Germany
135 DJI - Djibouti
124 DMA - Dominica
28 DNK - Denmark
57 DOM - Dominican Republic
184 DUBAI - United Arab Emirates ???
211 DZA - Algeria
36 ECU - Ecuador
78 EGY - Egypt
11 ESP - Spain
44 EST - Estonia
230 ETH - Ethiopia
110 FIN - Finland
192 FJI - Fiji
58 FRA - France
221 GAB - Gabon
32 GBR - United Kingdom
116 GEO - Georgia
21 GGY - Guernsey
115 GHA - Ghana
20 GIB - Gibraltar
226 GIN - Guinea
223 GMB - Gambia
233 GNB - Guinea-Bissau
235 GNQ - Equatorial Guinea
63 GRC - Greece
194 GRD - Grenada
37 GTM - Guatemala
156 GUM - Guam
231 GUY - Guyana
153 HK - Hong Kong
2 HKG - Hong Kong
86 HND - Honduras
140 HRV - Croatia
90 HTI - Haiti
48 HUN - Hungary
85 IDN - Indonesia
25 IMN - Isle of Man
120 IND - India
59 IOM - Isle Of Man
195 IRELD - Ireland
17 IRL - Ireland
111 IRN - Iran, Islamic Republic of
209 IRQ - Iraq
148 ISL - Iceland
19 ISR - Israel
60 ITA - Italy
158 JAM - Jamaica
14 JEY - Jersey
30 JOR - Jordan
73 JPN - Japan
169 JSY - Jersey
161 KAZ - Kazakhstan
101 KEN - Kenya
238 KGZ - Kyrgyzstan
205 KHM - Cambodia
71 KNA - Saint Kitts and Nevis
87 KOR - Korea, Republic of
89 KWT - Kuwait
178 LABUA - Labuan
202 LAO - Lao People's Democratic Republic
26 LBN - Lebanon
129 LBR - Liberia
144 LBY - Libya
84 LCA - Saint Lucia
189 LIBER - Liberia
10 LIE - Liechtenstein
149 LKA - Sri Lanka
112 LSO - Lesotho
105 LTU - Lithuania
34 LUX - Luxembourg
97 LVA - Latvia
114 MAC - Macao
222 MAF - Saint Martin (French part)
183 MALAY - Malaysia
122 MAR - Morocco
179 MARSH - Marshall Islands
181 MAURI - Mauritius
43 MCO - Monaco
163 MDA - Moldova, Republic of
212 MDG - Madagascar
203 MDV - Maldives
66 MEX - Mexico
180 MHL - Marshall Islands
121 MKD - Macedonia, the Former Yugoslav Republic of
159 MLI - Mali
54 MLT - Malta
201 MMR - Myanmar
160 MNE - Montenegro
206 MNG - Mongolia
204 MNP - Northern Mariana Islands
113 MOZ - Mozambique
219 MTQ - Martinique
39 MUS - Mauritius
154 MWI - Malawi
109 MYS - Malaysia
125 NAM - Namibia
229 NER - Niger
193 NETH - Netherlands
35 NEV - Nevada
198 NFK - Norfolk Island
98 NGA - Nigeria
93 NIC - Nicaragua
45 NIU - Niue
128 NIUE - Niue
47 NLD - Netherlands
103 NOR - Norway
200 NPL - Nepal
141 NRU - Nauru
55 NZL - New Zealand
157 OMN - Oman
143 PAK - Pakistan
8 PAN - Panama
67 PER - Peru
83 PHL - Philippines
27 PMA - Panama
199 PNG - Papua New Guinea
81 POL - Poland
152 PRI - Puerto Rico
177 PRK - Korea, Democratic People's Republic of
51 PRT - Portugal
76 PRY - Paraguay
232 PSE - Palestine, State of
197 PYF - French Polynesia
65 QAT - Qatar
49 RAK - Ras Al Khaimah
236 REU - Réunion
102 ROU - Romania
62 RUS - Russian Federation
214 RWA - Rwanda
1 SAM - Samoa
64 SAU - Saudi Arabia
92 SDN - Sudan
123 SEN - Senegal
96 SEY - Seychelles
6 SGP - Singapore
234 SLB - Solomon Islands
213 SLE - Sierra Leone
69 SLV - El Salvador
237 SMR - San Marino
215 SOM - Somalia
196 SRB - Serbia
182 STLU - St. Lucia
227 SUR - Suriname
174 SVK - Slovakia
82 SVN - Slovenia
79 SWE - Sweden
217 SWZ - Swaziland
132 SXM - Sint Maarten (Dutch part)
16 SYC - Seychelles
131 SYR - Syrian Arab Republic
94 TCA - Turks and Caicos Islands
155 TCD - Chad
224 TGO - Togo
12 THA - Thailand
191 THAIL - Thailand
220 TJK - Tajikistan
218 TKM - Turkmenistan
239 TON - Tonga
147 TTO - Trinidad and Tobago
138 TUN - Tunisia
41 TUR - Turkey
3 TWN - Taiwan, Province of China
151 TZA - Tanzania, United Republic of
145 UGA - Uganda
40 UK - United Kingdom
99 UKR - Ukraine
29 URY - Uruguay
42 USA - United States
133 UY - Uruguay
146 UZB - Uzbekistan
185 VANU - Vanuatu
88 VCT - Saint Vincent and the Grenadines
24 VEN - Venezuela, Bolivarian Republic of
80 VGB - Virgin Islands, British
150 VIR - Virgin Islands, U.S.
106 VNM - Viet Nam
162 VUT - Vanuatu
9 WSM - Samoa
170 WYO - Wyoming
175 XXX - Undetermined
117 YEM - Yemen
53 ZAF - South Africa
173 ZMB - Zambia
91 ZWE - Zimbabwe
Duplicates: 68=187, 167=188, 52=176, 4=190,130=186, 22=184, 2=153, 25=59, 17=195, 14=169, 129=189, 180=179, 39=181, 109=183, 47=193, 45=128, 8=27, 16=96, 12=191, 84=182, 23=40, 29=133, 162=185, 31=168, 9=1, 80=137.
Not in [[http://www.nationsonline.org/oneworld/country_code_list.htm|ISO Alpha-3]], [[https://en.wikipedia.org/wiki/ISO_3166-1_alpha-3|Wiki]]: ANG, LABUAN, NEV, RAK, WYO.
I considered all the above corrections in the file **''countries.csv''**.
import csv, sys, os, re
os.chdir('C:/Users/Batagelj/data/panama/csvs')
cnty = {}; countries = '../pajek/countries.csv'
with open(countries, newline='', encoding='utf-8') as cny:
cnyReader = csv.reader(cny, delimiter=';', quotechar='"')
try:
head = next(cnyReader); n = 0
for row in cnyReader:
n = n+1; L = re.split(',',row[0])
for e in L:
cnty[e] = n
print('{0:>3} {1:<5} {2}'.format(n,e,row[1]))
except csv.Error as e:
sys.exit('file {}, line {}: {}'.format(
countries, cnyReader.line_num, e))
>>>
=============== RESTART: C:/Users/batagelj/data/panama/test.py ===============
1 ABW Aruba
2 AGO Angola
3 AIA Anguilla
4 ALB Albania
5 AND Andorra
6 ANG British Anguilla
7 ARE United Arab Emirates
7 DUBAI United Arab Emirates
8 ARG Argentina
9 ARM Armenia
10 ASM American Samoa
11 ATG Antigua and Barbuda
12 AUS Australia
13 AUT Austria
14 AZE Azerbaijan
15 BEL Belgium
16 BEN Benin
17 BFA Burkina Faso
18 BGD Bangladesh
19 BGR Bulgaria
20 BHR Bahrain
21 BHS Bahamas
21 BAH Bahamas
22 BIH Bosnia and Herzegovina
23 BLR Belarus
24 BLZ Belize
25 BMU Bermuda
25 BERMU Bermuda
26 BOL Bolivia, Plurinational State of
27 BRA Brazil
28 BRB Barbados
29 BRN Brunei Darussalam
29 BRUN Brunei Darussalam
30 BTN Bhutan
31 BWA Botswana
32 CAF Central African Republic
33 CAN Canada
34 CHE Switzerland
35 CHL Chile
36 CHN China
36 CHINA China
37 CIV Côte d'Ivoire
38 CMR Cameroon
39 COD Congo, the Democratic Republic of the
40 COK Cook Islands
40 COOK Cook Islands
41 COL Colombia
42 CPV Cape Verde
43 CRI Costa Rica
44 CUB Cuba
45 CUW Curaçao
46 CYM Cayman Islands
46 CAYMN Cayman Islands
47 CYP Cyprus
48 CZE Czech Republic
49 DEU Germany
50 DJI Djibouti
51 DMA Dominica
52 DNK Denmark
53 DOM Dominican Republic
54 DZA Algeria
55 ECU Ecuador
56 EGY Egypt
57 ESP Spain
58 EST Estonia
59 ETH Ethiopia
60 FIN Finland
61 FJI Fiji
62 FRA France
63 GAB Gabon
64 GBR United Kingdom
64 UK United Kingdom
65 GEO Georgia
66 GGY Guernsey
67 GHA Ghana
68 GIB Gibraltar
69 GIN Guinea
70 GMB Gambia
71 GNB Guinea-Bissau
72 GNQ Equatorial Guinea
73 GRC Greece
74 GRD Grenada
75 GTM Guatemala
76 GUM Guam
77 GUY Guyana
78 HKG Hong Kong
78 HK Hong Kong
79 HND Honduras
80 HRV Croatia
81 HTI Haiti
82 HUN Hungary
83 IDN Indonesia
84 IMN Isle of Man
84 IOM Isle of Man
85 IND India
86 IRL Ireland
86 IRELD Ireland
87 IRN Iran, Islamic Republic of
88 IRQ Iraq
89 ISL Iceland
90 ISR Israel
91 ITA Italy
92 JAM Jamaica
93 JEY Jersey
93 JSY Jersey
94 JOR Jordan
95 JPN Japan
96 KAZ Kazakhstan
97 KEN Kenya
98 KGZ Kyrgyzstan
99 KHM Cambodia
100 KNA Saint Kitts and Nevis
101 KOR Korea, Republic of
102 KWT Kuwait
103 LAB Labuan
103 LABUA Labuan
104 LAO Lao People's Democratic Republic
105 LBN Lebanon
106 LBR Liberia
106 LIBER Liberia
107 LBY Libya
108 LCA Saint Lucia
108 STLU Saint Lucia
109 LIE Liechtenstein
110 LKA Sri Lanka
111 LSO Lesotho
112 LTU Lithuania
113 LUX Luxembourg
114 LVA Latvia
115 MAC Macao
116 MAF Saint Martin (French part)
117 MAR Morocco
118 MCO Monaco
119 MDA Moldova, Republic of
120 MDG Madagascar
121 MDV Maldives
122 MEX Mexico
123 MHL Marshall Islands
123 MARSH Marshall Islands
124 MKD Macedonia, the Former Yugoslav Republic of
125 MLI Mali
126 MLT Malta
127 MMR Myanmar
128 MNE Montenegro
129 MNG Mongolia
130 MNP Northern Mariana Islands
131 MOZ Mozambique
132 MTQ Martinique
133 MUS Mauritius
133 MAURI Mauritius
134 MWI Malawi
135 MYS Malaysia
135 MALAY Malaysia
136 NAM Namibia
137 NER Niger
138 NEV Nevada
139 NFK Norfolk Island
140 NGA Nigeria
141 NIC Nicaragua
142 NIU Niue
142 NIUE Niue
143 NLD Netherlands
143 NETH Netherlands
144 NOR Norway
145 NPL Nepal
146 NRU Nauru
147 NZL New Zealand
148 OMN Oman
149 PAK Pakistan
150 PAN Panama
150 PMA Panama
151 PER Peru
152 PHL Philippines
153 PNG Papua New Guinea
154 POL Poland
155 PRI Puerto Rico
156 PRK Korea, Democratic People's Republic of
157 PRT Portugal
158 PRY Paraguay
159 PSE Palestine, State of
160 PYF French Polynesia
161 QAT Qatar
162 RAK Ras Al Khaimah
163 REU Réunion
164 ROU Romania
165 RUS Russian Federation
166 RWA Rwanda
167 SAU Saudi Arabia
168 SDN Sudan
169 SEN Senegal
170 SGP Singapore
171 SLB Solomon Islands
172 SLE Sierra Leone
173 SLV El Salvador
174 SMR San Marino
175 SOM Somalia
176 SRB Serbia
177 SUR Suriname
178 SVK Slovakia
179 SVN Slovenia
180 SWE Sweden
181 SWZ Swaziland
182 SXM Sint Maarten (Dutch part)
183 SYC Seychelles
183 SEY Seychelles
184 SYR Syrian Arab Republic
185 TCA Turks and Caicos Islands
186 TCD Chad
187 TGO Togo
188 THA Thailand
188 THAIL Thailand
189 TJK Tajikistan
190 TKM Turkmenistan
191 TON Tonga
192 TTO Trinidad and Tobago
193 TUN Tunisia
194 TUR Turkey
195 TWN Taiwan, Province of China
196 TZA Tanzania, United Republic of
197 UGA Uganda
198 UKR Ukraine
199 URY Uruguay
199 UY Uruguay
200 USA United States
201 UZB Uzbekistan
202 VCT Saint Vincent and the Grenadines
203 VEN Venezuela, Bolivarian Republic of
204 VGB Virgin Islands, British
204 BVI Virgin Islands, British
205 VIR Virgin Islands, U.S.
206 VNM Viet Nam
207 VUT Vanuatu
207 VANU Vanuatu
208 WSM Samoa
208 SAM Samoa
209 WYO Wyoming
210 YEM Yemen
211 ZAF South Africa
212 ZMB Zambia
213 ZWE Zimbabwe
214 XXX Undetermined
I included at the beginning of program otherRead the reading of ordered country list (from the program test) into a dictionary cnty. The improved program that assigns to equivalent country names the same class number I named other2Read. I recomputed the files **''countries.net''** and **''panama.nam''**.
>>>
============ RESTART: C:/Users/batagelj/data/panama/other2Read.py ============
other2Read
started: Sun May 22 10:52:49 2016
1 ABW Aruba
2 AGO Angola
3 AIA Anguilla
4 ALB Albania
5 AND Andorra
6 ANG British Anguilla
7 ARE United Arab Emirates
7 DUBAI United Arab Emirates
...
208 WSM Samoa
208 SAM Samoa
209 WYO Wyoming
210 YEM Yemen
211 ZAF South Africa
212 ZMB Zambia
213 ZWE Zimbabwe
214 XXX Undetermined
r = 1 n = 838295 m = 365643
r = 2 n = 838295 m = 22860
r = 3 n = 838295 m = 252197
r = 4 n = 838295 m = 150162
['address', 'icij_id', 'valid_until', 'country_codes', 'countries', 'node_id', 'sourceID']
1 838296 ABW
2 838297 AGO
3 838298 AIA
4 838299 ALB
5 838300 AND
6 838301 ANG
7 838302 DUBAI
7 838302 ARE
...
208 838503 SAM
208 838503 WSM
209 838504 WYO
210 838505 YEM
211 838506 ZAF
212 838507 ZMB
213 838508 ZWE
214 838509 XXX
finished: Sun May 22 10:53:07 2016
Finally, I collected all Panama Papers Pajek network files in a ZIP file:
* **''panama.net''** - multirelational network from the file **''all_edges.csv''**
* **''nodesID.nam''** - names file with nodeIDs as names
* **''panamaL.nam''** - names file with long names as names
* **''panama.clu''** - partition specifying the source CSV file
* **''juris.clu''** - partition by jurisdiction country (the same country numbers as in network)
* **''countriesL.net''** - two-mode nodes X countries network with long names
* **''countriesL.nam''** - names file with long names of countries
They are contained in the ZIP file {{notes:zip:panama2.zip}}.