Rietveld Code Review Tool
Help | Bug tracker | Discussion group | Source code

Side by Side Diff: filters/get_subscriptions.py

Issue 5636796054503424: Issue 1170 - [adblockplus.org Anwiki to CMS migration] Migrate content (Closed)
Patch Set: Addressed palant's feedback. Created Feb. 26, 2015, 7:48 p.m.
Left:
Right:
Use n/p to move between diff chunks; N/P to move between comments.
Jump to:
View unified diff | Download patch
« no previous file with comments | « no previous file | filters/parse_interface.py » ('j') | includes/interface.tmpl » ('J')
Toggle Intra-line Diffs ('i') | Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
OLDNEW
(Empty)
1 # This file is part of the Adblock Plus website,
2 # Copyright (C) 2006-2015 Eyeo GmbH
3 #
4 # Adblock Plus is free software: you can redistribute it and/or modify
5 # it under the terms of the GNU General Public License version 3 as
6 # published by the Free Software Foundation.
7 #
8 # Adblock Plus is distributed in the hope that it will be useful,
9 # but WITHOUT ANY WARRANTY; without even the implied warranty of
10 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
11 # GNU General Public License for more details.
12 #
13 # You should have received a copy of the GNU General Public License
14 # along with Adblock Plus. If not, see <http://www.gnu.org/licenses/>.
15
16 import codecs, tarfile, urllib
Wladimir Palant 2015/02/26 20:35:03 Nit: One import per line please, as required by PE
kzar 2015/02/26 21:49:13 Done.
17
18 from sitescripts.subscriptions.subscriptionParser import parse_file, calculate_s upplemented
19
20 def get_subscriptions(_):
21 def subscription_dict(subscription):
22 d = subscription._data
23 if "supplemented" in d:
24 d["supplemented"] = [subscription_dict(s) for s in d["supplemented"]]
25 return d
Wladimir Palant 2015/02/26 20:35:03 Why is this necessary? The original template in th
kzar 2015/02/26 21:49:13 Done.
26
27 result = {}
28 source = urllib.urlopen("https://hg.adblockplus.org/subscriptionlist/archive/d efault.tar.gz")
29 with tarfile.open(fileobj=source, mode="r|gz") as archive:
30 for fileinfo in archive:
31 if not fileinfo.name.endswith(".subscription"):
32 continue
33
34 filedata = parse_file(fileinfo.name, codecs.getreader('utf8')(archive.extr actfile(fileinfo)))
35 if filedata.unavailable:
36 continue
37
38 result[filedata.name] = filedata
39
40 calculate_supplemented(result)
41 return map(subscription_dict, result.itervalues())
OLDNEW
« no previous file with comments | « no previous file | filters/parse_interface.py » ('j') | includes/interface.tmpl » ('J')

Powered by Google App Engine
This is Rietveld