asp.net HttpClient超时时处理TaskCanceledException

wgx48brx  于 2023-10-21  发布在  .NET
关注(0)|答案(1)|浏览(228)

我尝试使用Microsoft.Extensions.Http.Polly策略处理器在TaskCanceledException或http瞬时错误时重试,但它无法正常工作。
我写了下面这个最小的API只是为了测试:
Program.cs

using Polly;
using Polly.Extensions.Http;
using Polly.Retry;

WebApplicationBuilder builder = WebApplication.CreateBuilder(args);

AsyncRetryPolicy<HttpResponseMessage>? policy = HttpPolicyExtensions.HandleTransientHttpError()
    .Or<TaskCanceledException>()
    .WaitAndRetryAsync(5, _ => TimeSpan.FromSeconds(5));

builder.Services.AddHttpClient("test", client =>
    {
        client.BaseAddress = new Uri("http://localhost:5000");
        client.Timeout = TimeSpan.FromSeconds(2);
    })
    .AddPolicyHandler(policy);

WebApplication app = builder.Build();

app.MapPost("/status/{code}",
    async (string code, IHttpClientFactory httpClientFactory, CancellationToken cancellationToken) =>
    {
        HttpClient client = httpClientFactory.CreateClient("test");
        HttpResponseMessage response = await client.GetAsync($"/status/{code}", cancellationToken);

        response.EnsureSuccessStatusCode();

        return response.Content.ReadAsStringAsync(cancellationToken);
    });

app.MapPost("/timeout/{timeout:int}",
    async (int timeout, IHttpClientFactory httpClientFactory, CancellationToken cancellationToken) =>
    {
        HttpClient client = httpClientFactory.CreateClient("test");
        HttpResponseMessage response = await client.GetAsync($"/timeout/{timeout}", cancellationToken);

        response.EnsureSuccessStatusCode();

        return response.Content.ReadAsStringAsync(cancellationToken);
    });

#region Simulated API

app.MapGet("/status/{code:int}", (int code) => Results.StatusCode(code));

app.MapGet("/timeout/{timeout:int}", async (int timeout) =>
{
    await Task.Delay(TimeSpan.FromSeconds(timeout));
    return Results.Ok();
});

#endregion

app.Run();

在调用POST http://localhost:5000/timeout/10之后,它会引发这个异常,而不会进行任何进一步的尝试:

Microsoft.AspNetCore.Diagnostics.DeveloperExceptionPageMiddleware[1]
An unhandled exception has occurred while executing the request.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 2 seconds elapsing.
---> System.TimeoutException: A task was canceled.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
 at Polly.Retry.AsyncRetryEngine.ImplementationAsync[TResult](Func`3 action, Context context, CancellationToken cancellationToken, ExceptionPredicates shouldRetryExceptionPredicates, ResultPredicates`1 shouldRetryResultPredicates, Func`5 onRetryAsync, Int32 permittedRetryCount, IEnumerable`1 sleepDurationsEnumerable, Func`4 sleepDurationProvider, Boolean continueOnCapturedContext)
 at Polly.AsyncPolicy`1.ExecuteAsync(Func`3 action, Context context, CancellationToken cancellationToken, Boolean continueOnCapturedContext)       
 at Microsoft.Extensions.Http.PolicyHttpMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
 at Microsoft.Extensions.Http.Logging.LoggingScopeHttpMessageHandler.<>c__DisplayClass5_0.<<SendCoreAsync>g__Core|0>d.MoveNext()
--- End of stack trace from previous location ---
 at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
 --- End of inner exception stack trace ---
 --- End of inner exception stack trace ---
 at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts)
 at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
 at Program.<>c.<<<Main>$>b__0_3>d.MoveNext() in Z:\Repositories\POCs\PollyRetryTest\PollyRetryTest\Program.cs:line 35
--- End of stack trace from previous location ---
 at Microsoft.AspNetCore.Http.RequestDelegateFactory.<ExecuteTaskOfT>g__ExecuteAwaited|129_0[T](Task`1 task, HttpContext httpContext, JsonTypeInfo`1 jsonTypeInfo)
 at Microsoft.AspNetCore.Diagnostics.DeveloperExceptionPageMiddlewareImpl.Invoke(HttpContext context)

我做错了什么?我必须覆盖主处理程序吗

to94eoyn

to94eoyn1#

TL;DR:HttpClient的超时作为每个逻辑请求的超时(覆盖所有重试尝试),而不是每个传输请求(覆盖单个尝试)。
让我们看看我们有什么在这里:

  • 您有长时间运行的操作(10秒)
  • 您的重试策略最多允许5次重试尝试,每次尝试之间的延迟为5秒
  • 在HttpClient上,每个逻辑请求超时2秒
  • 因此,它不是每个传输请求的超时

让我们看看会发生什么:

  • 您针对长时间运行的操作发出请求
  • HttpClient超时
  • 重试策略生效
  • 如果为onRetry/onRetryAsync添加日志记录,则可以看到它仅触发一次
  • 然后它会休眠5秒钟
  • HttpClient的GetAsync调用抛出TCE,因为每个逻辑请求超时开始

解决方案

使用超时策略定义每个传输请求的超时

IAsyncPolicy<HttpResponseMessage> timeout = Policy.TimeoutAsync<HttpResponseMessage>(TimeSpan.FromSeconds(2));

IAsyncPolicy<HttpResponseMessage> retry = HttpPolicyExtensions.HandleTransientHttpError()
    .Or<TaskCanceledException>()
    .Or<TimeoutRejectedException>()
    .WaitAndRetryAsync(5, _ => TimeSpan.FromSeconds(5), 
        onRetry:(_, __) => Console.WriteLine("RETRIED"));

builder.Services.AddHttpClient("test", client =>
    {
        client.BaseAddress = new Uri("http://localhost:5000");
        client.Timeout = TimeSpan.FromSeconds(20);
    })
    .AddPolicyHandler(Policy.WrapAsync(retry, timeout));
  • timeout将用作每个传输请求的超时(2秒)
  • retry支持超时策略(Or<TimeoutRejectedException>()
  • 我添加了一些日志记录,以查看重试启动的次数
  • 我已经将HttpClient上的每个逻辑请求超时从2秒增加到20秒
  • 我将timeoutretry策略结合在一起,以便进行协作

您应该在日志中看到类似的内容:

RETRIED
...
RETRIED
...
RETRIED
...
TaskCancelledException thrown

让我们看看操作的顺序:

  • [00- 02 s]:初始请求抛出TimeoutRejectedException
  • @2s:打印RETRIED
  • [02- 07 s]:Polly正在睡觉
  • [07- 09 s]:第一次重试尝试抛出TimeoutRejectedException
  • @9s:打印RETRIED
  • [09-14s]:Polly is sleeping
  • [14- 16 s]:第二次重试尝试抛出TimeoutRejectedException
  • @16s:打印RETRIED
  • [16- 21]:波莉睡着了
  • @20s:HttpClient投掷TaskCancelledException

注意事项

请注意,您可以使用Polly实现每个逻辑请求和每个传输请求的超时

IAsyncPolicy<HttpResponseMessage> attemptSequenceTimeout = Policy
    .TimeoutAsync<HttpResponseMessage>(TimeSpan.FromSeconds(20));

IAsyncPolicy<HttpResponseMessage> attemptTimeout = Policy
    .TimeoutAsync<HttpResponseMessage>(TimeSpan.FromSeconds(2));

IAsyncPolicy<HttpResponseMessage> retry = HttpPolicyExtensions
    .HandleTransientHttpError()
    .Or<TimeoutRejectedException>()
    .WaitAndRetryAsync(5, _ => TimeSpan.FromSeconds(5), 
        onRetry:(_, __) => Console.WriteLine("RETRIED"));

var combinedPolicy =  Policy.WrapAsync(
    attemptSequenceTimeout, 
    retry, 
    attemptTimeout);

builder.Services.AddHttpClient("test", client =>
    {
        client.BaseAddress = new Uri("http://localhost:5000");
    })
    .AddPolicyHandler(combinedPolicy);

相关问题