Reactive WebClient GET Request with text/html response

Question

Currently I’m having an issue with new Spring 5 WebClient and I need some help to sort it out. The issue is:

I request some url that returns json response with content type text/html;charset=utf-8.

But unfortunately I’m still getting an exception: org.springframework.web.reactive.function.UnsupportedMediaTypeException: Content type 'text/html;charset=utf-8' not supported. So I can’t convert response to DTO.

For request I use following code:

Flux<SomeDTO> response = WebClient.create("https://someUrl")
                .get()
                .uri("/someUri").accept(MediaType.APPLICATION_JSON)
                .retrieve()
                .bodyToFlux(SomeDTO.class);

response.subscribe(System.out::println);

Btw, it really doesn’t matter which type I point in accept header, always returning text/html. So how could I get my response converted eventually?

MyClientHttpResponseDecorator(response) - Argument is ClientHttpResponse and in the map you are getting CLientResponse. Is this working ? — balaji, Aug 06 '18 at 01:25

score 13 · Answer 1 · answered Jul 15 '19 at 20:18

As mentioned in previous answer, you can use exchangeStrategies method,

example:

            Flux<SomeDTO> response = WebClient.builder()
                .baseUrl(url)
                .exchangeStrategies(ExchangeStrategies.builder().codecs(this::acceptedCodecs).build())
                .build()
                .get()
                .uri(builder.toUriString(), 1L)
                .retrieve()
                .bodyToFlux( // .. business logic


private void acceptedCodecs(ClientCodecConfigurer clientCodecConfigurer) {
    clientCodecConfigurer.customCodecs().encoder(new Jackson2JsonEncoder(new ObjectMapper(), TEXT_HTML));
    clientCodecConfigurer.customCodecs().decoder(new Jackson2JsonDecoder(new ObjectMapper(), TEXT_HTML));
}

How are you initializing the Mime type to use text/html here? — Trapper Davis, Aug 04 '21 at 18:29

Brian Clozel · Accepted Answer · 2018-04-11T10:34:10.133

Having a service send JSON with a "text/html" Content-Type is rather unusual.

There are two ways to deal with this:

configure the Jackson decoder to decode "text/html" content as well; look into the WebClient.builder().exchangeStrategies(ExchangeStrategies) setup method
change the "Content-Type" response header on the fly

Here's a proposal for the second solution:

WebClient client = WebClient.builder().filter((request, next) -> next.exchange(request)
                .map(response -> {
                    MyClientHttpResponseDecorator decorated = new 
                        MyClientHttpResponseDecorator(response); 
                    return decorated;
                })).build();

class MyClientHttpResponseDecorator extends ClientHttpResponseDecorator {

  private final HttpHeaders httpHeaders;

  public MyClientHttpResponseDecorator(ClientHttpResponse delegate) {
    super(delegate);
    this.httpHeaders = new HttpHeaders(this.getDelegate().getHeaders());
    // mutate the content-type header when necessary
  }

  @Override
  public HttpHeaders getHeaders() {
    return this.httpHeaders;
  }
}

Note that you should only use that client in that context (for this host). I'd strongly suggest to try and fix that strange content-type returned by the server, if you can.

Second option doesn't work. `UnsupportedOperationException` trying to modify a unmodifiable map Can you elaborate on your first option? — redent84, Apr 11 '18 at 10:11
I've updated my answer for solution 2) - you can decorate the client response to avoid that problem. I've also pointed to the right build method for changing the exchange strategies. — Brian Clozel, Apr 11 '18 at 10:34
MyClientHttpResponseDecorator decorated = new MyClientHttpResponseDecorator(response); But it seems that the `response` isn't a ClientHttpResponse. — Q_SJ, Nov 21 '18 at 15:31
Second solution doesnt't work liek Q_SJ said "response" seems not to be a ClientHttpResponse. — Anton Styopin, Mar 13 '19 at 10:39

score 1 · Answer 3 · answered Oct 04 '21 at 10:27

If you need to set the maxInMemorySize along with text/html response use:

  WebClient invoicesWebClient() {
    return WebClient.builder()
        .exchangeStrategies(ExchangeStrategies.builder().codecs(this::acceptedCodecs).build())
        .build();
  }

  private void acceptedCodecs(ClientCodecConfigurer clientCodecConfigurer) {
    clientCodecConfigurer.defaultCodecs().maxInMemorySize(BUFFER_SIZE_16MB);
    clientCodecConfigurer.customCodecs().registerWithDefaultConfig(new Jackson2JsonDecoder(new ObjectMapper(), TEXT_HTML));
    clientCodecConfigurer.customCodecs().registerWithDefaultConfig(new Jackson2JsonEncoder(new ObjectMapper(), TEXT_HTML));
  }

Reactive WebClient GET Request with text/html response

3 Answers3

Linked