Claude/configurable news reader g1 gdx by EthanThePhoenix38 · Pull Request #116 · ThePhoenixAgency/AI-Pulse

EthanThePhoenix38 · 2026-02-18T19:41:10Z

Continue Tasks: ▶️ 1 queued — View all

…xtraction

- Create security branch from main if it doesn't exist - Reset security to main if more than 50 commits behind - Handle merge conflicts by resetting to main first - Use force-with-lease for safer push https://claude.ai/code/session_0138bAjho1fWwiRZju3nJFJ3

…G1Gdx'

- Removed "Retour", "Accueil" and "Page précédente" buttons - Elevator arrows now match the style from readme-viewer.html: - Round buttons (border-radius: 50%) - Cyan color (#00d9ff) - Same hover effects - Position at bottom-right https://claude.ai/code/session_0138bAjho1fWwiRZju3nJFJ3

Copilot

Pull request overview

This PR adds paywall-bypass fallback extraction in the news aggregator, adjusts the reader UI styling/controls, and refines the Dependabot “secure flow” workflow to keep the security branch in sync with main.

Changes:

Add multi-service paywall bypass attempt (archive.ph / scribe.rip / web.archive.org) when extracted content looks paywalled.
Update reader UI layout/styles (e.g., elevator positioning / topbar/back controls per diff).
Update Dependabot secure-flow workflow logic to (re)create/reset security branch and improve merge handling.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 6 comments.

File	Description
`src/aggregator.js`	Adds paywall-bypass fetching/parsing and tweaks fallback summary generation; introduces paywall host scaffolding in `addUTMParams()`.
`reader.html`	Updates article view CSS and removes/repositions some navigation UI elements per diff.
`.github/workflows/dependabot-secure-flow.yaml`	Changes how `security` branch is ensured/updated and how Dependabot PR branches are merged into it.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-02-18T19:47:17Z

src/aggregator.js

+
+    // Liste des domaines avec paywalls stricts
+    const paywalledHosts = ['ft.com', 'wsj.com', 'economist.com', 'bloomberg.com', 'investing.com'];
+
+    // Ajouter Archive.ph en query parameter pour fallback
+    if (paywalledHosts.some(host => hostname.includes(host))) {
+      // On ne change pas l'URL ici, on l'utilisera comme fallback
+    }


Le bloc paywalledHosts est actuellement un no-op (aucune action dans le if) et ajoute du code mort / un commentaire trompeur ("Ajouter Archive.ph"), ce qui rend addUTMParams() plus difficile à maintenir. Soit implémenter réellement le fallback (ex: retourner une URL archive, ou exposer l’URL de fallback via un champ séparé), soit supprimer entièrement ce bloc.

Suggested change

// Liste des domaines avec paywalls stricts

const paywalledHosts = ['ft.com', 'wsj.com', 'economist.com', 'bloomberg.com', 'investing.com'];

// Ajouter Archive.ph en query parameter pour fallback

if (paywalledHosts.some(host => hostname.includes(host))) {

// On ne change pas l'URL ici, on l'utilisera comme fallback

}

Copilot · 2026-02-18T19:47:17Z

src/aggregator.js

+    const paywalledHosts = ['ft.com', 'wsj.com', 'economist.com', 'bloomberg.com', 'investing.com'];
+
+    // Ajouter Archive.ph en query parameter pour fallback
+    if (paywalledHosts.some(host => hostname.includes(host))) {


Le test hostname.includes(host) pour détecter des domaines paywallés est fragile (ex: notft.com matcherait ft.com). Le fichier a déjà un helper hostnameMatches(host, baseDomain) basé sur un match suffixe (host === domain || host.endsWith('.'+domain)); utilisez-le ici pour éviter des contournements et garder une logique cohérente.

Suggested change

if (paywalledHosts.some(host => hostname.includes(host))) {

if (paywalledHosts.some(host => hostnameMatches(hostname, host))) {

Copilot · 2026-02-18T19:47:18Z

src/aggregator.js

+          // Essayer les services de bypass avant de renoncer
+          const bypassResult = await tryPaywallBypass(resolvedArticleUrl);
+          if (bypassResult.success) {
+            const bypassDom = createSafeDom(bypassResult.html, resolvedArticleUrl);


tryPaywallBypass() ne retourne pas l’URL réellement utilisée (bypassUrl), et plus bas createSafeDom(bypassResult.html, resolvedArticleUrl) utilise l’URL d’origine comme base. Pour des HTML provenant de archive.ph / web.archive.org, cela peut casser la résolution des liens relatifs et fausser les heuristiques Readability. Retourner bypassUrl (ou finalUrl) et l’utiliser comme second paramètre de createSafeDom afin que document.URL/baseURI reflète la page parsée.

Suggested change

const bypassDom = createSafeDom(bypassResult.html, resolvedArticleUrl);

// Utiliser l'URL réellement utilisée par le service de bypass (si fournie)

const bypassBaseUrl = bypassResult.finalUrl || bypassResult.bypassUrl || resolvedArticleUrl;

const bypassDom = createSafeDom(bypassResult.html, bypassBaseUrl);

Copilot · 2026-02-18T19:47:18Z

src/aggregator.js

        } else {
+          // Contenu normal sans paywall
+          if (isLikelyBoilerplateExtraction(articleContent.textContent)) {
+            writeFallbackLocalArticle();
+          } else {
        if (!computedSummary || computedSummary.trim().length < 20) {
          computedSummary = trimPromotionalTailText(cleanupNoiseText(sanitizeText(articleContent.textContent.slice(0, 1400))));
        }


La logique imbriquée autour du cas "contenu normal" (paywall/boilerplate) a une indentation incohérente et des blocs else difficiles à lire (ex: if (!computedSummary...) n’est pas indenté sous le else). Merci de réindenter/reformater ce bloc pour éviter des erreurs futures lors de modifications (et faciliter la vérification des accolades/branches).

Copilot · 2026-02-18T19:47:18Z

.github/workflows/dependabot-secure-flow.yaml

+        git fetch origin main
+        if git fetch origin security 2>/dev/null; then
+          # Security branch exists, check if it's behind main
+          git checkout security
+          BEHIND=$(git rev-list --count HEAD..origin/main)
+          if [ "$BEHIND" -gt 50 ]; then
+            echo "Security branch is $BEHIND commits behind main. Resetting to main..."
+            git reset --hard origin/main
+          fi


Dans l’étape "Ensure security branch exists", git checkout security peut échouer si la branche locale security n’existe pas (actions/checkout ne la crée pas forcément). Il faut checkout/mettre à jour explicitement depuis origin/security (ex: créer/forcer la branche locale à pointer sur origin/security) avant de calculer le retard et éventuellement reset.

Copilot · 2026-02-18T19:47:18Z

.github/workflows/dependabot-secure-flow.yaml

+        if ! git merge origin/${{ github.head_ref }} --no-edit; then
+          echo "Merge conflict detected, aborting and retrying with main as base..."
+          git merge --abort || true
+          git reset --hard origin/main
+          git merge origin/${{ github.head_ref }} --no-edit || true


La fusion utilise git merge origin/${{ github.head_ref }}, mais juste avant le fetch est fait via ${head_ref}:${head_ref} (création d’une branche locale), ce qui ne garantit pas l’existence/à-jour de origin/${head_ref}. Résultat possible: merge qui échoue / merge d’une ref obsolète, puis push de security sans les changements Dependabot. Ajuster soit le fetch (pour alimenter refs/remotes/origin/${head_ref}), soit la commande merge pour cibler la branche locale ${{ github.head_ref }} ou FETCH_HEAD.

Suggested change

if ! git merge origin/${{ github.head_ref }} --no-edit; then

echo "Merge conflict detected, aborting and retrying with main as base..."

git merge --abort || true

git reset --hard origin/main

git merge origin/${{ github.head_ref }} --no-edit || true

if ! git merge ${{ github.head_ref }} --no-edit; then

echo "Merge conflict detected, aborting and retrying with main as base..."

git merge --abort || true

git reset --hard origin/main

git merge ${{ github.head_ref }} --no-edit || true

claude added 4 commits February 18, 2026 13:53

feat: Add Archive.ph and paywall bypass services for better article e…

1182bcf

…xtraction

Merge remote-tracking branch 'origin/claude/configurable-news-reader-…

8afbf6f

…G1Gdx'

EthanThePhoenix38 marked this pull request as ready for review February 18, 2026 19:41

Copilot AI review requested due to automatic review settings February 18, 2026 19:41

github-actions bot added backend configuration ci-cd frontend labels Feb 18, 2026

EthanThePhoenix38 merged commit 1f21c28 into main Feb 18, 2026
8 checks passed

EthanThePhoenix38 deleted the claude/configurable-news-reader-G1Gdx branch February 18, 2026 19:41

Copilot started reviewing on behalf of EthanThePhoenix38 February 18, 2026 19:41 View session

Copilot AI reviewed Feb 18, 2026

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Claude/configurable news reader g1 gdx#116

Claude/configurable news reader g1 gdx#116
EthanThePhoenix38 merged 4 commits intomainfrom
claude/configurable-news-reader-G1Gdx

EthanThePhoenix38 commented Feb 18, 2026 •

edited by continue bot

Loading

Uh oh!

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Feb 18, 2026

Uh oh!

Copilot AI Feb 18, 2026

Uh oh!

Copilot AI Feb 18, 2026

Uh oh!

Copilot AI Feb 18, 2026

Uh oh!

Copilot AI Feb 18, 2026

Uh oh!

Copilot AI Feb 18, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

	if (paywalledHosts.some(host => hostname.includes(host))) {
	if (paywalledHosts.some(host => hostnameMatches(hostname, host))) {

-            const bypassDom = createSafeDom(bypassResult.html, resolvedArticleUrl);
+            // Utiliser l'URL réellement utilisée par le service de bypass (si fournie)
+            const bypassBaseUrl = bypassResult.finalUrl || bypassResult.bypassUrl || resolvedArticleUrl;
+            const bypassDom = createSafeDom(bypassResult.html, bypassBaseUrl);

Uh oh!

Conversation

EthanThePhoenix38 commented Feb 18, 2026 • edited by continue bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Feb 18, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

EthanThePhoenix38 commented Feb 18, 2026 •

edited by continue bot

Loading