forked from ARGOeu/argo-connectors
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathargo-egi-connectors.spec
279 lines (267 loc) · 13.3 KB
/
argo-egi-connectors.spec
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
Name: argo-egi-connectors
Version: 1.7.0
Release: 1%{?dist}
Group: EGI/SA4
License: ASL 2.0
Summary: Components generate input for ARGO Compute Engine
Url: http://argoeu.github.io/guides/sync/
Vendor: SRCE <[email protected]>
Obsoletes: ar-sync
Prefix: %{_prefix}
Requires: argo-ams-library
Requires: avro
Requires: pyOpenSSL
Source0: %{name}-%{version}.tar.gz
BuildArch: noarch
BuildRoot: %{_tmppath}/%{name}-%{version}-%{release}-buildroot
%description
Installs the components for syncing ARGO Compute Engine
with GOCDB, VAPOR and POEM definitions per day.
%prep
%setup -n %{name}-%{version}
%build
python setup.py build
%install
python setup.py install -O1 --root=$RPM_BUILD_ROOT --record=INSTALLED_FILES
install --directory %{buildroot}/%{_sharedstatedir}/argo-connectors/
install --directory %{buildroot}/%{_localstatedir}/log/argo-connectors/
install --directory %{buildroot}/%{_libexecdir}/argo-egi-connectors/
%clean
rm -rf $RPM_BUILD_ROOT
%files -f INSTALLED_FILES
%config(noreplace) /etc/argo-egi-connectors/*
%attr(0755,root,root) %dir %{_libexecdir}/argo-egi-connectors/
%attr(0755,root,root) %{_libexecdir}/argo-egi-connectors/*.py*
%attr(0644,root,root) %{_sysconfdir}/cron.d/*
%attr(0755,root,root) %dir %{_sharedstatedir}/argo-connectors/
%attr(0755,root,root) %dir %{_localstatedir}/log/argo-connectors/
%changelog
* Wed May 23 2018 Daniel Vrcic <[email protected]> - 1.7.0-1%{?dist}
- ARGO-1093 Support for GOCDB paginated topology API
- ARGO-1080 add support for basic-auth in Connectors
- ARGO-966 Lower state files permissions
* Tue Mar 27 2018 Daniel Vrcic <[email protected]> - 1.6.1-1%{?dist}
- selectively use GOCDB paginated API for topology
* Thu Nov 30 2017 Daniel Vrcic <[email protected]> - 1.6.0-1%{?dist}
- ARGO-965 Support for packing connectors data in a single AMS message
- ARGO-921 Use ComputationPower instead of HEPSPEC2006 value for weights
- ARGO-906 No explicit exit on connection problem so state file will be written
- ARGO-886 Finer retry logic
- ARGO-872 Tenant and jobname in retries log msgs
- ARGO-853 Connectors retry to fetch data
- ARGO-843 Write/send data as it is data for passed date
- ARGO-842 Connectors dedicated file logger
- ARGO-549 Use of AMS for delivering topology, downtimes, POEM profile and weights
- added unit tests
* Tue Apr 25 2017 Daniel Vrcic <[email protected]> - 1.5.9-1%{?dist}
- ARGO-724 Each connector must try to create states directory structure
* Wed Mar 29 2017 Daniel Vrcic <[email protected]> - 1.5.8-1%{?dist}
- ARGO-766 Remove SRMv2 service type mapping
* Mon Mar 20 2017 Daniel Vrcic <[email protected]> - 1.5.7-1%{?dist}
- ARGO-767 Remove topology-vo connector
- refactored topology filtering
- removed schema migration helper
* Fri Mar 17 2017 Daniel Vrcic <[email protected]> - 1.5.6-1%{?dist}
- ARGO-762 Remove inspection logic of HEPSPEC factors for previous days
* Thu Mar 9 2017 Daniel Vrcic <[email protected]> - 1.5.5-1%{?dist}
- ARGO-713 Topology connector should be able to pick only particular NGI or site
* Mon Jan 30 2017 Daniel Vrcic <[email protected]> - 1.5.4-1%{?dist}
- ARGO-667 filter endpoints whose groups are filtered in groups of groups
* Wed Jan 25 2017 Daniel Vrcic <[email protected]> - 1.5.3-3%{?dist}
- prefilter output datestamp with underscores
* Wed Jan 25 2017 Daniel Vrcic <[email protected]> - 1.5.3-2%{?dist}
- prefilter datestamp extracted from arg tuple
* Thu Jan 19 2017 Daniel Vrcic <[email protected]> - 1.5.3-1%{?dist}
- poem and output files as arguments to prefilter
- refactored filename datestamp creation
* Wed Jan 4 2017 Daniel Vrcic <[email protected]> - 1.5.2-1%{?dist}
- ARGO-550 Introduce states that can be checked by Nagios probe
* Thu Nov 24 2016 Daniel Vrcic <[email protected]> - 1.5.1-2%{?dist}
- remove code for nagioses defined in obsoleted nagios-roles.conf
- catch JSON parse errors
- catch XML parse errors
* Fri Oct 28 2016 Daniel Vrcic <[email protected]> - 1.5.1-1%{?dist}
- ARGO-584 Ensure to catch all exceptions of underlying library
* Sat Sep 24 2016 Themis Zamani <[email protected]> - 1.5.0-1%{?dist}
- New RPM package release
* Wed Aug 31 2016 Daniel Vrcic <[email protected]> - 1.4.6-2%{?dist}
- make use of VAPOR service for weights
- extended cert verification with CAfile bundle
* Tue Feb 16 2016 Daniel Vrcic <[email protected]> - 1.4.6-1%{?dist}
- topology data without mixed int and string values
* Mon Feb 1 2016 Daniel Vrcic <[email protected]> - 1.4.5-3%{?dist}
- poem connector optional write data needed for prefilter
https://github.com/ARGOeu/ARGO/issues/184
* Tue Jan 12 2016 Daniel Vrcic <[email protected]> - 1.4.5-2%{?dist}
- weights connector refactored
- README updated
https://github.com/ARGOeu/ARGO/issues/181
* Sun Jan 10 2016 Daniel Vrcic <[email protected]> - 1.4.5-1%{?dist}
- log failed VO and weights connections
https://github.com/ARGOeu/ARGO/issues/179
- added connection timeout for all connectors
- config files can be passed as arguments to every component
https://github.com/ARGOeu/ARGO/issues/180
- added connection retry feature forr all connectors
- prefilter explicit input and output
- reorganized prefilter global.conf
- DATE placeholder in global.conf so interpolation can be used
- prefilter poem_sync.out look back option
- remove obsoleted logging
- guide updated
- refactored connection retries
* Thu Oct 15 2015 Daniel Vrcic <[email protected]> - 1.4.4-6%{?dist}
- bugfix handling lowercase defined POEM profiles
- remove hardcoded customer name for topology-gocdb-connector
https://github.com/ARGOeu/ARGO/issues/173
- guide updated with new configuration option for customer
* Thu Oct 8 2015 Daniel Vrcic <[email protected]> - 1.4.4-5%{?dist}
- bugfix in case of no downtimes defined for given date
https://github.com/ARGOeu/ARGO/issues/170
* Wed Oct 7 2015 Daniel Vrcic <[email protected]> - 1.4.4-4%{?dist}
- poem-connector urlparse bugfix
* Wed Oct 7 2015 Daniel Vrcic <[email protected]> - 1.4.4-3%{?dist}
- grab all distinct scopes for feed
* Tue Oct 6 2015 Daniel Vrcic <[email protected]> - 1.4.4-2%{?dist}
- fix initialization of loggers in config parsers
- backward compatible exception messages
* Fri Oct 2 2015 Daniel Vrcic <[email protected]> - 1.4.4-1%{?dist}
- filter SRM endpoints too
- refactored use of logging
- connectors can verify server certificate
https://github.com/ARGOeu/ARGO/issues/153
- report correct number of fetched endpoints even if SRM endpoints were being filtered
- connectors handle help argument and describe basic info and usage
https://github.com/ARGOeu/ARGO/issues/169
- removed hardcoded scopes and grab them dynamically from config
https://github.com/ARGOeu/ARGO/issues/168
- report config parser errors via logger
- downtimes connector complain if wrong date specified
- remove notion of default scope
- doc moved to repo
- updated doc with server's cert validate options
* Wed Aug 19 2015 Daniel Vrcic <[email protected]> - 1.4.3-3%{?dist}
- fix exception in case of returned HTTP 500 for other connectors
* Sat Aug 15 2015 Daniel Vrcic <[email protected]> - 1.4.3-2%{?dist}
- fix poem-connector exception in case of returned HTTP 500
* Mon Aug 10 2015 Daniel Vrcic <[email protected]> - 1.4.3-1%{?dist}
- generate meaningful statistic messages for every connector
- messages are written into syslog
https://github.com/ARGOeu/ARGO/issues/116
* Wed Jul 15 2015 Daniel Vrcic <[email protected]> - 1.4.2-2%{?dist}
- fixed bug with duplicating poem profiles info for prefilter
- fixed bug with SRM service type handling for topology and downtimes connectors
* Tue Jun 23 2015 Daniel Vrcic <[email protected]> - 1.4.2-1%{?dist}
- changed internal parser structure to address entities with doubled scope
https://github.com/ARGOeu/ARGO/issues/141
* Tue Jun 2 2015 Daniel Vrcic <[email protected]> - 1.4.1-5%{?dist}
- new path and filename for consumer logs
* Thu May 28 2015 Daniel Vrcic <[email protected]> - 1.4.1-4%{?dist}
- migrate.py lower on resources
* Thu May 21 2015 Daniel Vrcic <[email protected]> - 1.4.1-3%{?dist}
- migration script to transform old data to new avro schema with map type
https://github.com/ARGOeu/ARGO/issues/134
* Mon May 18 2015 Daniel Vrcic <[email protected]> - 1.4.1-2%{?dist}
- GridPP VO job example
- downtimes filename day timestamp is queried one
https://github.com/ARGOeu/ARGO/issues/133
* Wed May 6 2015 Daniel Vrcic <[email protected]> - 1.4.1-1%{?dist}
- removed VO as an entity in configuration; only customers and set of jobs
- multiple customers in config each with own outputdir
- data feeds for all connectors can be defined per job
- prefilter-egi.py is aware of multiple customers
- avro schemas with generic tags
- case insensitive sections and options
- setup.py with automatic version catch from spec
- new default config
https://github.com/ARGOeu/ARGO/issues/132
* Fri Apr 17 2015 Daniel Vrcic <[email protected]> - 1.4.0-10%{?dist}
- VO jobs are moved under customer's directory
* Wed Apr 8 2015 Daniel Vrcic <[email protected]> - 1.4.0-9%{?dist}
- handle group type names with whitespaces
- fixed bug with filtering VO groups across multiple VO jobs
* Fri Apr 3 2015 Daniel Vrcic <[email protected]> - 1.4.0-8%{?dist}
- added Dirname optional option for VO config
- correctly renamed avro schemas
* Mon Mar 30 2015 Daniel Vrcic <[email protected]> - 1.4.0-7%{?dist}
- added README.md with a basic project info
* Sun Mar 29 2015 Daniel Vrcic <[email protected]> - 1.4.0-6%{?dist}
- renamed weights and more configs refactoring
- put scripts back into libexec
* Fri Mar 27 2015 Daniel Vrcic <[email protected]> - 1.4.0-5%{?dist}
- minor code cleanups and renamed connectors to reflect the source of data
* Fri Mar 27 2015 Daniel Vrcic <[email protected]> - 1.4.0-4%{?dist}
- poem server is defined in its config file, not global one
* Fri Mar 27 2015 Daniel Vrcic <[email protected]> - 1.4.0-3%{?dist}
- prefilter-egi.py cleanups and roll back missing file
* Fri Mar 27 2015 Daniel Vrcic <[email protected]> - 1.4.0-2%{?dist}
- deleted leftovers
* Fri Mar 27 2015 Daniel Vrcic <[email protected]> - 1.4.0-1%{?dist}
- refactor the configuration of connectors/components
https://github.com/ARGOeu/ARGO/issues/114
- fixed topology connector for VO'es to produce correct GE and GG avro files
https://github.com/ARGOeu/ARGO/issues/121
- use of distutils for package building
* Tue Feb 17 2015 Daniel Vrcic <[email protected]> - 1.3.1-16%{?dist}
- prefilter-avro has fixed configuration
* Thu Feb 12 2015 Daniel Vrcic <[email protected]> - 1.3.1-15%{?dist}
- legacy SRM service type handle for downtime syncs
* Tue Feb 10 2015 Daniel Vrcic <[email protected]> - 1.3.1-14%{?dist}
- updated .spec with removed configs for a per job prefilter-avro
* Tue Feb 10 2015 Daniel Vrcic <[email protected]> - 1.3.1-13%{?dist}
- different internal handle of avro poem-sync so it doesn't contain duplicated entries
- special handle of legacy SRM service type
* Thu Feb 5 2015 Daniel Vrcic <[email protected]> - 1.3.1-12%{?dist}
- plaintxt prefilter has fixed configuration
* Tue Feb 3 2015 Daniel Vrcic <[email protected]> - 1.3.1-11%{?dist}
- update .spec to deploy new configs
- removed whitespaces at the end of config lines
* Mon Feb 2 2015 Daniel Vrcic <[email protected]> - 1.3.1-10%{?dist}
- tools can have config file as their argument
- config files with changed output directory for customer/job
- modified cronjobs for customer and his two jobs
* Thu Jan 29 2015 Daniel Vrcic <[email protected]> - 1.3.1-9%{?dist}
- bug fixes for poem-sync and prefilter
- typo in plaintext groups filename
* Mon Jan 19 2015 Daniel Vrcic <[email protected]> - 1.3.1-8%{?dist}
- topology-sync: avro schemas updated with tags and filtering by tags values
- poem-sync: avro schema updated with tags
- poem-sync: output profiles per customer and job
https://github.com/ARGOeu/ARGO/issues/85
* Thu Jan 15 2015 Luko Gjenero <[email protected]> - 1.3.1-3%{?dist}
- avro prefiltering
* Wed Dec 17 2014 Daniel Vrcic <[email protected]> - 1.3.1-2%{?dist}
- ar-sync is missing avro dependency
- poem-sync is missing data for servers listed in URL
* Thu Nov 27 2014 Luko Gjenero <[email protected]> - 1.3.0-0%{?dist}
- Avro format for poem, downtimes, topology and hepspec
* Tue May 13 2014 Paschalis Korosoglou <[email protected]> - 1.2.3-1%{?dist}
- Added logging to sync components
* Fri Apr 26 2014 Luko Gjenero <[email protected]> - 1.2.2-1%{?dist}
- Updated prefilter
* Tue Mar 18 2014 Paschalis Korosoglou <[email protected]> - 1.2.1-1%{?dist}
- Updated daily cronjobs to run within first five minutes of each day
* Thu Jan 30 2014 Paschalis Korosoglou <[email protected]> - 1.1.19-1%{?dist}
- Updated daily cronjobs to run within first hour of each day
* Tue Jan 14 2014 Paschalis Korosoglou <[email protected]> - 1.1.18-1%{?dist}
- Added daily cronjob for hepspec values
* Thu Nov 28 2013 Luko Gjenero <[email protected]> - 1.1.16-3%{?dist}
- Fixed prefilter
* Thu Nov 28 2013 Luko Gjenero <[email protected]> - 1.1.16-2%{?dist}
- Fixed prefilter
* Thu Nov 28 2013 Luko Gjenero <[email protected]> - 1.1.16-1%{?dist}
- Updated prefilter
* Thu Nov 13 2013 Luko Gjenero <[email protected]> - 1.1.15-1%{?dist}
- VO Sync component
* Fri Nov 8 2013 Paschalis Korosoglou <[email protected]> - 1.1.0-1%{?dist}
- Inclusion of hepspec sync plus cronjobs
* Mon Nov 4 2013 Paschalis Korosoglou <[email protected]> - 1.0.0-6%{?dist}
- Fixes in consumer
* Tue Sep 17 2013 Paschalis Korosoglou <[email protected]> - 1.0.0-5%{?dist}
- Fix in prefilter
* Mon Sep 9 2013 Paschalis Korosoglou <[email protected]> - 1.0.0-4%{?dist}
- Rebuilt with fixed downtimes issue
* Thu Aug 29 2013 Paschalis Korosoglou <[email protected]> - 1.0.0-2%{?dist}
- Minor change in prefilter script
* Thu Aug 1 2013 Luko Gjenero <[email protected]> - 1.0.0-1%{?dist}
- Initial release