LEFT | RIGHT |
1 #!/usr/bin/env python | 1 #!/usr/bin/env python |
2 """Anonymize data in access log lines. | 2 """Anonymize data in access log lines. |
3 | 3 |
4 Read a line from stdin, write it to stdout with the following changes: | 4 Read a line from stdin, write it to stdout with the following changes: |
5 1. IP (v4 or v6) replaced with a salted hash of the IP and the date | 5 1. IP (v4 or v6) replaced with a salted hash of the IP and the date |
6 2. Country and city information (extracted from IP) added after the salted hash. | 6 2. Country and city information (extracted from IP) added after the salted hash. |
7 | 7 |
8 If the country or city information is unavailable in the database, '-' is added
instead | 8 If the country or city information is unavailable in the database, |
9 of ISO 3166-1 alpha-2 country/city code (like 'DE'). | 9 '-' is added instead of ISO 3166-1 alpha-2 country code (like DE) & |
| 10 city name (like 'Berlin'). |
10 | 11 |
11 Salt and the country/city information database are taken as command line options
and | 12 Salt and the country/city information database are taken |
12 default to environment variables. | 13 as command line options and default to environment variables. |
13 | 14 |
14 Malformed lines are passed on as is, based on the assumption that they don't | 15 Malformed lines are passed on as is, based on the assumption that they don't |
15 contain sensitive information. Malformed here means the line couldn't be split | 16 contain sensitive information. Malformed here means the line couldn't be split |
16 on space character. If it could be split, and an error occurs afterwards | 17 on space character. If it could be split, and an error occurs afterwards |
17 (e.g. while trying to parse out the date), the script will fail and exit in | 18 (e.g. while trying to parse out the date), the script will fail and exit in |
18 order to bring attention to the fact that something might not be getting | 19 order to bring attention to the fact that something might not be getting |
19 anonymized. | 20 anonymized. |
20 """ | 21 """ |
21 | 22 |
22 from __future__ import print_function | 23 from __future__ import print_function |
(...skipping 81 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
104 ) | 105 ) |
105 | 106 |
106 args = parser.parse_args() | 107 args = parser.parse_args() |
107 | 108 |
108 if args.salt is None or args.country_db is None or args.city_db is None: | 109 if args.salt is None or args.country_db is None or args.city_db is None: |
109 parser.print_help() | 110 parser.print_help() |
110 sys.exit(1) | 111 sys.exit(1) |
111 | 112 |
112 main(args.salt, args.country_db, args.city_db) | 113 main(args.salt, args.country_db, args.city_db) |
113 | 114 |
LEFT | RIGHT |