Files
av-parser/src/AvParser.Core/Parsing/IParser.cs
T
Leonid PershinandClaude Opus 5 44fb0d3a5f Gate network parsers on a working proxy and remember what worked
The pool now warms up from what the previous run learned instead of starting
cold every launch. Startup probes the remembered proxies first, stops as soon
as ProxyMinimumLive of them answer, and writes the survivors to
proxies.state.json after the warm-up and again on shutdown. Only proxies that
ever answered are stored: the feed republishes a few thousand dead addresses
every five minutes, and "was dead an hour ago" says almost nothing.

Remembered state is a hint, not a verdict. A restored proxy sorts first in the
warm-up queue but is not counted live until it answers in this session -
otherwise a launch a week later would report live proxies it had never spoken
to, the warm-up would skip the very entries it exists to re-check, and the
parser gate would open on week-old evidence.

That gate is the other half: a parser declaring RequiresNetwork will not run
while the pool has nothing live. The Parse page disables the run button and
shows a banner that leads to the Proxies page. Parsers that work on pasted text
are never gated - they have nothing to route, and blocking them would make the
app useless whenever the public lists are down. Two new settings cover the
escape hatch and the target: "allow network parsers without a proxy" and how
many live proxies to find at startup.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-08-13 19:11:51 +03:00

42 lines
1.6 KiB
C#

namespace AvParser.Core.Parsing;
/// <summary>
/// The pluggable unit of the whole application: turns one input into a stream of outcomes.
/// </summary>
/// <remarks>
/// Results are streamed rather than returned as a batch so that the UI can render partial
/// results, report progress and honour cancellation on inputs of arbitrary size.
/// </remarks>
public interface IParser<in TInput, TOutput>
{
/// <summary>Stable identifier used for persistence and lookup. Never localise this.</summary>
string Id { get; }
/// <summary>Human-readable name shown in the UI.</summary>
string DisplayName { get; }
/// <summary>One-line explanation of what this parser accepts.</summary>
string Description { get; }
/// <summary>Cheap structural check — must not throw and must not do IO.</summary>
bool CanParse(TInput input);
/// <summary>
/// Whether this parser makes network requests and therefore needs a working proxy.
/// </summary>
/// <remarks>
/// A default implementation rather than an abstract member, so adding a parser stays a
/// one-line change: a parser that works on text the user pasted opts out by saying nothing.
/// Parsers that fetch anything must set this, or they will run direct even when the user has
/// asked for proxy-only operation.
/// </remarks>
bool RequiresNetwork => false;
/// <summary>Streams one outcome per logical record.</summary>
IAsyncEnumerable<ParseOutcome<TOutput>> ParseAsync(
TInput input,
IProgress<ParseProgress>? progress,
CancellationToken cancellationToken
);
}