Project

General

Profile

Bug #14770

Bug #10288: Fix newly identified issues to make our test suite more robust and faster

"Fetching OpenPGP keys" scenarios are fragile

Added by intrigeri 10 months ago. Updated 7 months ago.

Status:
In Progress
Priority:
Normal
Assignee:
Category:
Test suite
Target version:
-
Start date:
10/04/2017
Due date:
% Done:

0%

QA Check:
Feature Branch:
Type of work:
Code
Blueprint:
Starter:
Affected tool:

Description

The temporary solution implemented in #12211 is not robust enough: while doing #12291 I see lots of failures in August. Thankfully we've discussed (and agreed on) better options on #12211.


Related issues

Related to Tails - Bug #12211: Adapt GnuPG automated tests after switching to an Onion keyserver Resolved 02/03/2017
Related to Tails - Bug #10378: The "Tails OpenPGP keys" scenario is fragile Resolved 10/15/2015
Related to Tails - Feature #9519: Make the test suite more deterministic through network simulation In Progress 06/02/2015
Related to Tails - Bug #15415: Unreliable key server operations Resolved 03/14/2018

Associated revisions

Revision 1db04699 (diff)
Added by intrigeri 7 months ago

Test suite: tag "Feature: Keyserver interaction with GnuPG" @fragile (refs: #14770)

History

#1 Updated by intrigeri 10 months ago

  • Blocked by Feature #12292: Deal with September 2017 false positive scenarios added

#2 Updated by intrigeri 10 months ago

  • Related to Bug #12211: Adapt GnuPG automated tests after switching to an Onion keyserver added

#3 Updated by intrigeri 10 months ago

  • Related to Bug #10378: The "Tails OpenPGP keys" scenario is fragile added

#4 Updated by anonym 8 months ago

  • Target version changed from Tails_3.3 to Tails_3.5

#5 Updated by intrigeri 7 months ago

  • Related to Feature #9519: Make the test suite more deterministic through network simulation added

#6 Updated by intrigeri 7 months ago

Wrt. the best long-term option we've selected on #12211 ("Run a local mock keyserver onion. This doesn't depend on the Internet => potentially 100% robust"), I've read that Schleuder 3 does mock the keyserver in its test suite. Likely that's in Ruby so we could maybe reuse it easily :)

#7 Updated by anonym 7 months ago

  • Target version deleted (Tails_3.5)

#8 Updated by intrigeri 7 months ago

  • Type of work changed from Research to Code

intrigeri wrote:

bertagaz said on #12290#note-8 that these failures had disappeared in September, so I'm not flagging these scenarios as fragile: instead, while doing #12292 anonym should check this and act accordingly, hence making this a Research ticket on anonym's plate for this month.

I've just seen this happen again (https://jenkins.tails.boum.org/view/RM/job/test_Tails_ISO_stable/1085/) so I've tagged these scenarios as fragile.

#9 Updated by intrigeri 7 months ago

  • Description updated (diff)

#10 Updated by intrigeri 7 months ago

  • Blocked by deleted (Feature #12292: Deal with September 2017 false positive scenarios)

#11 Updated by intrigeri 7 months ago

  • Status changed from Confirmed to In Progress

#12 Updated by sajolida 4 months ago

  • Related to Bug #15415: Unreliable key server operations added

Also available in: Atom PDF