Rietveld Code Review Tool
Help | Bug tracker | Discussion group | Source code

Side by Side Diff: sitescripts/filterhits/geometrical_mean.py

Issue 4615801646612480: Issue 395 - Filter hits statistics backend (Closed)
Patch Set: Create temporary log directory with tempfile module for tests. Created March 30, 2015, 7 p.m.
Left:
Right:
Use n/p to move between diff chunks; N/P to move between comments.
Jump to:
View unified diff | Download patch
OLDNEW
(Empty)
1 # coding: utf-8
2
3 # This file is part of the Adblock Plus web scripts,
4 # Copyright (C) 2006-2015 Eyeo GmbH
5 #
6 # Adblock Plus is free software: you can redistribute it and/or modify
7 # it under the terms of the GNU General Public License version 3 as
8 # published by the Free Software Foundation.
9 #
10 # Adblock Plus is distributed in the hope that it will be useful,
11 # but WITHOUT ANY WARRANTY; without even the implied warranty of
12 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
13 # GNU General Public License for more details.
14 #
15 # You should have received a copy of the GNU General Public License
16 # along with Adblock Plus. If not, see <http://www.gnu.org/licenses/>.
17
18 import itertools
19
20 from sitescripts.filterhits import db
21
22 def update(interval, data):
23 """
24 Generator that provides all the SQL and parameters needed to update the
25 aggregations for the given data + interval in the database.
26 """
27 for filter, filter_data in data['filters'].iteritems():
28 yield ("""INSERT IGNORE INTO `filters`
29 (filter, sha1) VALUES (%s, UNHEX(SHA1(filter)))""", filter)
30
31 domains = itertools.chain(filter_data.get("thirdParty", {}).iteritems(),
32 filter_data.get("firstParty", {}).iteritems())
33 for domain, domain_data in domains:
34 yield ("""INSERT INTO `frequencies`
35 (filter_sha1, domain, frequency, timestamp)
36 VALUES (UNHEX(SHA1(%s)), %s, %s, FROM_UNIXTIME(%s))
37 ON DUPLICATE KEY UPDATE
38 frequency = (
39 POW(frequency, 1 - (UNIX_TIMESTAMP(VALUES(timestamp)) -
40 UNIX_TIMESTAMP(timestamp)) / %s) *
41 POW(VALUES(frequency), (UNIX_TIMESTAMP(VALUES(timestamp)) -
42 UNIX_TIMESTAMP(timestamp)) / %s)),
43 timestamp = VALUES(timestamp)""",
44 filter, domain, domain_data["hits"],
45 int(domain_data["latest"] / 1000), interval, interval)
OLDNEW

Powered by Google App Engine
This is Rietveld