You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/10/30 03:33:32 UTC
[GitHub] [arrow] jduo opened a new pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
jduo opened a new pull request #8554:
URL: https://github.com/apache/arrow/pull/8554
Add a ClientMiddleware that can read HTTP Set-Cookie and Set-Cookie2 headers
from server responses and transmit corresponding Cookie headers
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#issuecomment-719154603
https://issues.apache.org/jira/browse/ARROW-10428
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
lidavidm commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r518471847
##########
File path: java/flight/flight-core/src/main/java/org/apache/arrow/flight/client/ClientCookieMiddleware.java
##########
@@ -0,0 +1,106 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.net.HttpCookie;
+import java.util.List;
+import java.util.concurrent.ConcurrentHashMap;
+import java.util.concurrent.ConcurrentMap;
+import java.util.function.Consumer;
+import java.util.stream.Collectors;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.FlightClientMiddleware;
+import org.apache.arrow.util.VisibleForTesting;
+
+/**
+ * A client middleware for receiving and sending cookie information.
+ * Note that this class will not persist permanent cookies beyond the lifetime
+ * of this session.
+ */
+public class ClientCookieMiddleware implements FlightClientMiddleware {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private final Factory factory;
+
+ @VisibleForTesting
+ ClientCookieMiddleware(Factory factory) {
+ this.factory = factory;
+ }
+
+ /**
+ * Factory used within FlightClient.
+ */
+ public static class Factory implements FlightClientMiddleware.Factory {
+ // Use a map to track the most recent version of a cookie from the server.
+ // Note that cookie names are case-sensitive (but header names aren't).
+ private ConcurrentMap<String, HttpCookie> cookies = new ConcurrentHashMap<>();
+
+ @Override
+ public ClientCookieMiddleware onCallStarted(CallInfo info) {
+ return new ClientCookieMiddleware(this);
+ }
+ }
+
+ @Override
+ public void onBeforeSendingHeaders(CallHeaders outgoingHeaders) {
+ final String cookieValue = getValidCookiesAsString();
+ if (!cookieValue.isEmpty()) {
+ outgoingHeaders.insert(COOKIE_HEADER, cookieValue);
+ }
+ }
+
+ @Override
+ public void onHeadersReceived(CallHeaders incomingHeaders) {
+ // Note: A cookie defined once will continue to be used in all subsequent
+ // requests on the client instance. The server can send the same cookie again
+ // with a different value and the client will use the new value in future requests.
+ // The server can also update a cookie to have an Expiry in the past or negative age
+ // to signal that the client should stop using the cookie immediately.
+ final Consumer<String> handleSetCookieHeader = (headerValue) -> {
+ final List<HttpCookie> parsedCookies = HttpCookie.parse(headerValue);
Review comment:
Also instead of a lambda it may be clearer to define Factory#updateFromSetCookieHeader or something like that.
##########
File path: java/flight/flight-core/src/main/java/org/apache/arrow/flight/client/ClientCookieMiddleware.java
##########
@@ -0,0 +1,106 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.net.HttpCookie;
+import java.util.List;
+import java.util.concurrent.ConcurrentHashMap;
+import java.util.concurrent.ConcurrentMap;
+import java.util.function.Consumer;
+import java.util.stream.Collectors;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.FlightClientMiddleware;
+import org.apache.arrow.util.VisibleForTesting;
+
+/**
+ * A client middleware for receiving and sending cookie information.
+ * Note that this class will not persist permanent cookies beyond the lifetime
+ * of this session.
+ */
+public class ClientCookieMiddleware implements FlightClientMiddleware {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private final Factory factory;
+
+ @VisibleForTesting
+ ClientCookieMiddleware(Factory factory) {
+ this.factory = factory;
+ }
+
+ /**
+ * Factory used within FlightClient.
+ */
+ public static class Factory implements FlightClientMiddleware.Factory {
+ // Use a map to track the most recent version of a cookie from the server.
+ // Note that cookie names are case-sensitive (but header names aren't).
+ private ConcurrentMap<String, HttpCookie> cookies = new ConcurrentHashMap<>();
+
+ @Override
+ public ClientCookieMiddleware onCallStarted(CallInfo info) {
+ return new ClientCookieMiddleware(this);
+ }
+ }
+
+ @Override
+ public void onBeforeSendingHeaders(CallHeaders outgoingHeaders) {
+ final String cookieValue = getValidCookiesAsString();
+ if (!cookieValue.isEmpty()) {
+ outgoingHeaders.insert(COOKIE_HEADER, cookieValue);
+ }
+ }
+
+ @Override
+ public void onHeadersReceived(CallHeaders incomingHeaders) {
+ // Note: A cookie defined once will continue to be used in all subsequent
+ // requests on the client instance. The server can send the same cookie again
+ // with a different value and the client will use the new value in future requests.
+ // The server can also update a cookie to have an Expiry in the past or negative age
+ // to signal that the client should stop using the cookie immediately.
+ final Consumer<String> handleSetCookieHeader = (headerValue) -> {
+ final List<HttpCookie> parsedCookies = HttpCookie.parse(headerValue);
Review comment:
Should we handle IllegalArgumentException here from HttpCookie.parse?
##########
File path: java/flight/flight-core/src/test/java/org/apache/arrow/flight/client/TestCookieHandling.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.io.IOException;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.Criteria;
+import org.apache.arrow.flight.ErrorFlightMetadata;
+import org.apache.arrow.flight.FlightClient;
+import org.apache.arrow.flight.FlightInfo;
+import org.apache.arrow.flight.FlightProducer;
+import org.apache.arrow.flight.FlightServer;
+import org.apache.arrow.flight.FlightServerMiddleware;
+import org.apache.arrow.flight.FlightTestUtil;
+import org.apache.arrow.flight.NoOpFlightProducer;
+import org.apache.arrow.flight.RequestContext;
+import org.apache.arrow.memory.BufferAllocator;
+import org.apache.arrow.memory.RootAllocator;
+import org.apache.arrow.util.AutoCloseables;
+import org.junit.After;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Ignore;
+import org.junit.Test;
+
+/**
+ * Tests for correct handling of cookies from the FlightClient using {@link ClientCookieMiddleware}.
+ */
+public class TestCookieHandling {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private BufferAllocator allocator;
+ private FlightServer server;
+ private FlightClient client;
+
+ private ClientCookieMiddlewareTestFactory testFactory = new ClientCookieMiddlewareTestFactory();
+ private ClientCookieMiddleware cookieMiddleware = new ClientCookieMiddleware(testFactory);
+
+ @Before
+ public void setup() throws Exception {
+ allocator = new RootAllocator(Long.MAX_VALUE);
+ startServerAndClient();
+ }
+
+ @After
+ public void cleanup() throws Exception {
+ cookieMiddleware = new ClientCookieMiddleware(testFactory);
+ AutoCloseables.close(client, server, allocator);
+ client = null;
+ server = null;
+ allocator = null;
+ }
+
+ @Test
+ public void basicCookie() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieStaysAfterMultipleRequests() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieAutoExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ try {
+ Thread.sleep(5000);
Review comment:
This is a little icky, though it appears there's no way to mock time for HttpCookie.
##########
File path: java/flight/flight-core/src/test/java/org/apache/arrow/flight/client/TestCookieHandling.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.io.IOException;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.Criteria;
+import org.apache.arrow.flight.ErrorFlightMetadata;
+import org.apache.arrow.flight.FlightClient;
+import org.apache.arrow.flight.FlightInfo;
+import org.apache.arrow.flight.FlightProducer;
+import org.apache.arrow.flight.FlightServer;
+import org.apache.arrow.flight.FlightServerMiddleware;
+import org.apache.arrow.flight.FlightTestUtil;
+import org.apache.arrow.flight.NoOpFlightProducer;
+import org.apache.arrow.flight.RequestContext;
+import org.apache.arrow.memory.BufferAllocator;
+import org.apache.arrow.memory.RootAllocator;
+import org.apache.arrow.util.AutoCloseables;
+import org.junit.After;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Ignore;
+import org.junit.Test;
+
+/**
+ * Tests for correct handling of cookies from the FlightClient using {@link ClientCookieMiddleware}.
+ */
+public class TestCookieHandling {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private BufferAllocator allocator;
+ private FlightServer server;
+ private FlightClient client;
+
+ private ClientCookieMiddlewareTestFactory testFactory = new ClientCookieMiddlewareTestFactory();
+ private ClientCookieMiddleware cookieMiddleware = new ClientCookieMiddleware(testFactory);
+
+ @Before
+ public void setup() throws Exception {
+ allocator = new RootAllocator(Long.MAX_VALUE);
+ startServerAndClient();
+ }
+
+ @After
+ public void cleanup() throws Exception {
+ cookieMiddleware = new ClientCookieMiddleware(testFactory);
+ AutoCloseables.close(client, server, allocator);
+ client = null;
+ server = null;
+ allocator = null;
+ }
+
+ @Test
+ public void basicCookie() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieStaysAfterMultipleRequests() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieAutoExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ try {
+ Thread.sleep(5000);
+ } catch (InterruptedException ignored) {
+ }
+
+ // Verify that the k cookie was discarded because it expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
+ }
+
+ @Test
+ public void cookieExplicitlyExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=-2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+
+ // Verify that the k cookie was discarded because the server told the client it is expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
Review comment:
It seems this test doesn't always succeed.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm closed pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
lidavidm closed pull request #8554:
URL: https://github.com/apache/arrow/pull/8554
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
lidavidm commented on pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#issuecomment-723341323
Will merge on green.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jduo commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
jduo commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r517601440
##########
File path: java/flight/flight-core/src/main/java/org/apache/arrow/flight/client/ClientCookieMiddleware.java
##########
@@ -0,0 +1,99 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.net.HttpCookie;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.function.Consumer;
+import java.util.stream.Collectors;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.FlightClientMiddleware;
+import org.apache.arrow.util.VisibleForTesting;
+
+/**
+ * A client middleware for receiving and sending cookie information.
+ * Note that this class will not persist permanent cookies beyond the lifetime
+ * of this session.
+ */
+public class ClientCookieMiddleware implements FlightClientMiddleware {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String SET_COOKIE2_HEADER = "Set-Cookie2";
+ private static final String COOKIE_HEADER = "Cookie";
+
+ // Use a map to track the most recent version of a cookie from the server.
+ // Note that cookie names are case-sensitive (but header names aren't).
+ private Map<String, HttpCookie> cookies = new HashMap<>();
Review comment:
Done.
##########
File path: java/flight/flight-core/src/main/java/org/apache/arrow/flight/client/ClientCookieMiddleware.java
##########
@@ -0,0 +1,99 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.net.HttpCookie;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.function.Consumer;
+import java.util.stream.Collectors;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.FlightClientMiddleware;
+import org.apache.arrow.util.VisibleForTesting;
+
+/**
+ * A client middleware for receiving and sending cookie information.
+ * Note that this class will not persist permanent cookies beyond the lifetime
+ * of this session.
+ */
+public class ClientCookieMiddleware implements FlightClientMiddleware {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String SET_COOKIE2_HEADER = "Set-Cookie2";
Review comment:
Removed Set-Cookie2 support.
##########
File path: java/flight/flight-core/src/main/java/org/apache/arrow/flight/client/ClientCookieMiddleware.java
##########
@@ -0,0 +1,99 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.net.HttpCookie;
+import java.util.HashMap;
+import java.util.List;
+import java.util.Map;
+import java.util.function.Consumer;
+import java.util.stream.Collectors;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.FlightClientMiddleware;
+import org.apache.arrow.util.VisibleForTesting;
+
+/**
+ * A client middleware for receiving and sending cookie information.
+ * Note that this class will not persist permanent cookies beyond the lifetime
+ * of this session.
+ */
+public class ClientCookieMiddleware implements FlightClientMiddleware {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String SET_COOKIE2_HEADER = "Set-Cookie2";
+ private static final String COOKIE_HEADER = "Cookie";
+
+ // Use a map to track the most recent version of a cookie from the server.
+ // Note that cookie names are case-sensitive (but header names aren't).
+ private Map<String, HttpCookie> cookies = new HashMap<>();
+
+ public ClientCookieMiddleware() {
+ }
+
+ /**
+ * Factory used within FlightClient.
+ */
+ public static class Factory implements FlightClientMiddleware.Factory {
+ @Override
+ public ClientCookieMiddleware onCallStarted(CallInfo info) {
+ return new ClientCookieMiddleware();
+ }
+ }
+
+ @Override
+ public void onBeforeSendingHeaders(CallHeaders outgoingHeaders) {
+ final String cookieValue = calculateCookieString();
+ if (!cookieValue.isEmpty()) {
+ outgoingHeaders.insert(COOKIE_HEADER, cookieValue);
+ }
+ }
+
+ @Override
+ public void onHeadersReceived(CallHeaders incomingHeaders) {
+ // Note: A cookie defined once will continue to be used in all subsequent
+ // requests on the client instance. The server can send the same cookie again
+ // with a different value and the client will use the new value in future requests.
+ // The server can also update a cookie to have an Expiry in the past or negative age
+ // to signal that the client should stop using the cookie immediately.
+ final Consumer<String> handleSetCookieHeader = (headerValue) -> {
+ final List<HttpCookie> parsedCookies = HttpCookie.parse(headerValue);
+ parsedCookies.forEach(parsedCookie -> cookies.put(parsedCookie.getName(), parsedCookie));
+ };
+ incomingHeaders.getAll(SET_COOKIE_HEADER).forEach(handleSetCookieHeader);
+ incomingHeaders.getAll(SET_COOKIE2_HEADER).forEach(handleSetCookieHeader);
+ }
+
+ @Override
+ public void onCallCompleted(CallStatus status) {
+
+ }
+
+ @VisibleForTesting
+ String calculateCookieString() {
Review comment:
Done.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jduo commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
jduo commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r519045924
##########
File path: java/flight/flight-core/src/main/java/org/apache/arrow/flight/client/ClientCookieMiddleware.java
##########
@@ -0,0 +1,106 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.net.HttpCookie;
+import java.util.List;
+import java.util.concurrent.ConcurrentHashMap;
+import java.util.concurrent.ConcurrentMap;
+import java.util.function.Consumer;
+import java.util.stream.Collectors;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.FlightClientMiddleware;
+import org.apache.arrow.util.VisibleForTesting;
+
+/**
+ * A client middleware for receiving and sending cookie information.
+ * Note that this class will not persist permanent cookies beyond the lifetime
+ * of this session.
+ */
+public class ClientCookieMiddleware implements FlightClientMiddleware {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private final Factory factory;
+
+ @VisibleForTesting
+ ClientCookieMiddleware(Factory factory) {
+ this.factory = factory;
+ }
+
+ /**
+ * Factory used within FlightClient.
+ */
+ public static class Factory implements FlightClientMiddleware.Factory {
+ // Use a map to track the most recent version of a cookie from the server.
+ // Note that cookie names are case-sensitive (but header names aren't).
+ private ConcurrentMap<String, HttpCookie> cookies = new ConcurrentHashMap<>();
+
+ @Override
+ public ClientCookieMiddleware onCallStarted(CallInfo info) {
+ return new ClientCookieMiddleware(this);
+ }
+ }
+
+ @Override
+ public void onBeforeSendingHeaders(CallHeaders outgoingHeaders) {
+ final String cookieValue = getValidCookiesAsString();
+ if (!cookieValue.isEmpty()) {
+ outgoingHeaders.insert(COOKIE_HEADER, cookieValue);
+ }
+ }
+
+ @Override
+ public void onHeadersReceived(CallHeaders incomingHeaders) {
+ // Note: A cookie defined once will continue to be used in all subsequent
+ // requests on the client instance. The server can send the same cookie again
+ // with a different value and the client will use the new value in future requests.
+ // The server can also update a cookie to have an Expiry in the past or negative age
+ // to signal that the client should stop using the cookie immediately.
+ final Consumer<String> handleSetCookieHeader = (headerValue) -> {
+ final List<HttpCookie> parsedCookies = HttpCookie.parse(headerValue);
Review comment:
Done
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jduo commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
jduo commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r519046814
##########
File path: java/flight/flight-core/src/test/java/org/apache/arrow/flight/client/TestCookieHandling.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.io.IOException;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.Criteria;
+import org.apache.arrow.flight.ErrorFlightMetadata;
+import org.apache.arrow.flight.FlightClient;
+import org.apache.arrow.flight.FlightInfo;
+import org.apache.arrow.flight.FlightProducer;
+import org.apache.arrow.flight.FlightServer;
+import org.apache.arrow.flight.FlightServerMiddleware;
+import org.apache.arrow.flight.FlightTestUtil;
+import org.apache.arrow.flight.NoOpFlightProducer;
+import org.apache.arrow.flight.RequestContext;
+import org.apache.arrow.memory.BufferAllocator;
+import org.apache.arrow.memory.RootAllocator;
+import org.apache.arrow.util.AutoCloseables;
+import org.junit.After;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Ignore;
+import org.junit.Test;
+
+/**
+ * Tests for correct handling of cookies from the FlightClient using {@link ClientCookieMiddleware}.
+ */
+public class TestCookieHandling {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private BufferAllocator allocator;
+ private FlightServer server;
+ private FlightClient client;
+
+ private ClientCookieMiddlewareTestFactory testFactory = new ClientCookieMiddlewareTestFactory();
+ private ClientCookieMiddleware cookieMiddleware = new ClientCookieMiddleware(testFactory);
+
+ @Before
+ public void setup() throws Exception {
+ allocator = new RootAllocator(Long.MAX_VALUE);
+ startServerAndClient();
+ }
+
+ @After
+ public void cleanup() throws Exception {
+ cookieMiddleware = new ClientCookieMiddleware(testFactory);
+ AutoCloseables.close(client, server, allocator);
+ client = null;
+ server = null;
+ allocator = null;
+ }
+
+ @Test
+ public void basicCookie() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieStaysAfterMultipleRequests() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieAutoExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ try {
+ Thread.sleep(5000);
+ } catch (InterruptedException ignored) {
+ }
+
+ // Verify that the k cookie was discarded because it expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
+ }
+
+ @Test
+ public void cookieExplicitlyExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=-2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+
+ // Verify that the k cookie was discarded because the server told the client it is expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
Review comment:
So I looked into this and found that on my Mac, the JDK explicitly checks if Max-Age == -1 (MAX_AGE_UNSPECIFIED), treat the max age as unset.
In the OpenJDK 11 source code though, they treat any negative number as max age unset:
https://github.com/openjdk/jdk11u-dev/blob/75a42602826c32a1053b10188ec3826eb9c0c898/src/java.base/share/classes/java/net/HttpCookie.java#L236
The RFC states that 0, and any value less than zero is supposed to be treated as immediately expired.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
lidavidm commented on pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#issuecomment-722400276
Just to link things: #8572 is implementing support for arbitrary headers, perhaps we should think about if cookies should build on top of that support.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jduo commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
jduo commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r518941906
##########
File path: java/flight/flight-core/src/test/java/org/apache/arrow/flight/client/TestCookieHandling.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.io.IOException;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.Criteria;
+import org.apache.arrow.flight.ErrorFlightMetadata;
+import org.apache.arrow.flight.FlightClient;
+import org.apache.arrow.flight.FlightInfo;
+import org.apache.arrow.flight.FlightProducer;
+import org.apache.arrow.flight.FlightServer;
+import org.apache.arrow.flight.FlightServerMiddleware;
+import org.apache.arrow.flight.FlightTestUtil;
+import org.apache.arrow.flight.NoOpFlightProducer;
+import org.apache.arrow.flight.RequestContext;
+import org.apache.arrow.memory.BufferAllocator;
+import org.apache.arrow.memory.RootAllocator;
+import org.apache.arrow.util.AutoCloseables;
+import org.junit.After;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Ignore;
+import org.junit.Test;
+
+/**
+ * Tests for correct handling of cookies from the FlightClient using {@link ClientCookieMiddleware}.
+ */
+public class TestCookieHandling {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private BufferAllocator allocator;
+ private FlightServer server;
+ private FlightClient client;
+
+ private ClientCookieMiddlewareTestFactory testFactory = new ClientCookieMiddlewareTestFactory();
+ private ClientCookieMiddleware cookieMiddleware = new ClientCookieMiddleware(testFactory);
+
+ @Before
+ public void setup() throws Exception {
+ allocator = new RootAllocator(Long.MAX_VALUE);
+ startServerAndClient();
+ }
+
+ @After
+ public void cleanup() throws Exception {
+ cookieMiddleware = new ClientCookieMiddleware(testFactory);
+ AutoCloseables.close(client, server, allocator);
+ client = null;
+ server = null;
+ allocator = null;
+ }
+
+ @Test
+ public void basicCookie() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieStaysAfterMultipleRequests() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieAutoExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ try {
+ Thread.sleep(5000);
Review comment:
I'll mark this test as @Ignore, since this is essentially just testing that we call isExpired correctly, which we do in the max-age -2 test.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jduo commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
jduo commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r519047132
##########
File path: java/flight/flight-core/src/test/java/org/apache/arrow/flight/client/TestCookieHandling.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.io.IOException;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.Criteria;
+import org.apache.arrow.flight.ErrorFlightMetadata;
+import org.apache.arrow.flight.FlightClient;
+import org.apache.arrow.flight.FlightInfo;
+import org.apache.arrow.flight.FlightProducer;
+import org.apache.arrow.flight.FlightServer;
+import org.apache.arrow.flight.FlightServerMiddleware;
+import org.apache.arrow.flight.FlightTestUtil;
+import org.apache.arrow.flight.NoOpFlightProducer;
+import org.apache.arrow.flight.RequestContext;
+import org.apache.arrow.memory.BufferAllocator;
+import org.apache.arrow.memory.RootAllocator;
+import org.apache.arrow.util.AutoCloseables;
+import org.junit.After;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Ignore;
+import org.junit.Test;
+
+/**
+ * Tests for correct handling of cookies from the FlightClient using {@link ClientCookieMiddleware}.
+ */
+public class TestCookieHandling {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private BufferAllocator allocator;
+ private FlightServer server;
+ private FlightClient client;
+
+ private ClientCookieMiddlewareTestFactory testFactory = new ClientCookieMiddlewareTestFactory();
+ private ClientCookieMiddleware cookieMiddleware = new ClientCookieMiddleware(testFactory);
+
+ @Before
+ public void setup() throws Exception {
+ allocator = new RootAllocator(Long.MAX_VALUE);
+ startServerAndClient();
+ }
+
+ @After
+ public void cleanup() throws Exception {
+ cookieMiddleware = new ClientCookieMiddleware(testFactory);
+ AutoCloseables.close(client, server, allocator);
+ client = null;
+ server = null;
+ allocator = null;
+ }
+
+ @Test
+ public void basicCookie() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieStaysAfterMultipleRequests() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieAutoExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ try {
+ Thread.sleep(5000);
+ } catch (InterruptedException ignored) {
+ }
+
+ // Verify that the k cookie was discarded because it expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
+ }
+
+ @Test
+ public void cookieExplicitlyExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=-2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+
+ // Verify that the k cookie was discarded because the server told the client it is expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
Review comment:
I've changed this test to use Max-Age==0 and added a comment.
This bug is still in OpenJDK 15: https://github.com/openjdk/jdk15u/blob/a96a5c59ac49ffb063b093a2674ede2deed87b13/src/java.base/share/classes/java/net/HttpCookie.java#L242
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jduo commented on pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
jduo commented on pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#issuecomment-722504311
> Just to link things: #8572 is implementing support for arbitrary headers, perhaps we should think about if cookies should build on top of that support.
I'm leaning towards keeping this as just middleware and not involving CallOptions. #8572 is for letting the client arbitrarily add headers at the time of a request, whereas cookie-headers aren't arbitrary and should be automatically sent. The checking of expiration should also be automatic.
We could rework this patch to have a subclass of HeaderCallOption that lazily retrieves the cookie header from the cookie middleware during wrapStub, but I feel this is more difficult/error-prone for app-developers.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] jduo commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
jduo commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r519049014
##########
File path: java/flight/flight-core/src/test/java/org/apache/arrow/flight/client/TestCookieHandling.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.io.IOException;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.Criteria;
+import org.apache.arrow.flight.ErrorFlightMetadata;
+import org.apache.arrow.flight.FlightClient;
+import org.apache.arrow.flight.FlightInfo;
+import org.apache.arrow.flight.FlightProducer;
+import org.apache.arrow.flight.FlightServer;
+import org.apache.arrow.flight.FlightServerMiddleware;
+import org.apache.arrow.flight.FlightTestUtil;
+import org.apache.arrow.flight.NoOpFlightProducer;
+import org.apache.arrow.flight.RequestContext;
+import org.apache.arrow.memory.BufferAllocator;
+import org.apache.arrow.memory.RootAllocator;
+import org.apache.arrow.util.AutoCloseables;
+import org.junit.After;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Ignore;
+import org.junit.Test;
+
+/**
+ * Tests for correct handling of cookies from the FlightClient using {@link ClientCookieMiddleware}.
+ */
+public class TestCookieHandling {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private BufferAllocator allocator;
+ private FlightServer server;
+ private FlightClient client;
+
+ private ClientCookieMiddlewareTestFactory testFactory = new ClientCookieMiddlewareTestFactory();
+ private ClientCookieMiddleware cookieMiddleware = new ClientCookieMiddleware(testFactory);
+
+ @Before
+ public void setup() throws Exception {
+ allocator = new RootAllocator(Long.MAX_VALUE);
+ startServerAndClient();
+ }
+
+ @After
+ public void cleanup() throws Exception {
+ cookieMiddleware = new ClientCookieMiddleware(testFactory);
+ AutoCloseables.close(client, server, allocator);
+ client = null;
+ server = null;
+ allocator = null;
+ }
+
+ @Test
+ public void basicCookie() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieStaysAfterMultipleRequests() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieAutoExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ try {
+ Thread.sleep(5000);
+ } catch (InterruptedException ignored) {
+ }
+
+ // Verify that the k cookie was discarded because it expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
+ }
+
+ @Test
+ public void cookieExplicitlyExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=-2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+
+ // Verify that the k cookie was discarded because the server told the client it is expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
Review comment:
I added a note about this in ClientCookieMiddleware's class description.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
lidavidm commented on pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#issuecomment-722749650
> I'm leaning towards keeping this as just middleware and not involving CallOptions.
Sounds good to me.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] lidavidm commented on a change in pull request #8554: ARROW-10428: [FlightRPC][Java] Add support for HTTP cookies
Posted by GitBox <gi...@apache.org>.
lidavidm commented on a change in pull request #8554:
URL: https://github.com/apache/arrow/pull/8554#discussion_r519050438
##########
File path: java/flight/flight-core/src/test/java/org/apache/arrow/flight/client/TestCookieHandling.java
##########
@@ -0,0 +1,252 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.arrow.flight.client;
+
+import java.io.IOException;
+
+import org.apache.arrow.flight.CallHeaders;
+import org.apache.arrow.flight.CallInfo;
+import org.apache.arrow.flight.CallStatus;
+import org.apache.arrow.flight.Criteria;
+import org.apache.arrow.flight.ErrorFlightMetadata;
+import org.apache.arrow.flight.FlightClient;
+import org.apache.arrow.flight.FlightInfo;
+import org.apache.arrow.flight.FlightProducer;
+import org.apache.arrow.flight.FlightServer;
+import org.apache.arrow.flight.FlightServerMiddleware;
+import org.apache.arrow.flight.FlightTestUtil;
+import org.apache.arrow.flight.NoOpFlightProducer;
+import org.apache.arrow.flight.RequestContext;
+import org.apache.arrow.memory.BufferAllocator;
+import org.apache.arrow.memory.RootAllocator;
+import org.apache.arrow.util.AutoCloseables;
+import org.junit.After;
+import org.junit.Assert;
+import org.junit.Before;
+import org.junit.Ignore;
+import org.junit.Test;
+
+/**
+ * Tests for correct handling of cookies from the FlightClient using {@link ClientCookieMiddleware}.
+ */
+public class TestCookieHandling {
+ private static final String SET_COOKIE_HEADER = "Set-Cookie";
+ private static final String COOKIE_HEADER = "Cookie";
+ private BufferAllocator allocator;
+ private FlightServer server;
+ private FlightClient client;
+
+ private ClientCookieMiddlewareTestFactory testFactory = new ClientCookieMiddlewareTestFactory();
+ private ClientCookieMiddleware cookieMiddleware = new ClientCookieMiddleware(testFactory);
+
+ @Before
+ public void setup() throws Exception {
+ allocator = new RootAllocator(Long.MAX_VALUE);
+ startServerAndClient();
+ }
+
+ @After
+ public void cleanup() throws Exception {
+ cookieMiddleware = new ClientCookieMiddleware(testFactory);
+ AutoCloseables.close(client, server, allocator);
+ client = null;
+ server = null;
+ allocator = null;
+ }
+
+ @Test
+ public void basicCookie() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieStaysAfterMultipleRequests() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=v", cookieMiddleware.getValidCookiesAsString());
+ }
+
+ @Test
+ public void cookieAutoExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ try {
+ Thread.sleep(5000);
+ } catch (InterruptedException ignored) {
+ }
+
+ // Verify that the k cookie was discarded because it expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
+ }
+
+ @Test
+ public void cookieExplicitlyExpires() {
+ CallHeaders headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+ // Note: using max-age changes cookie version from 0->1, which quotes values.
+ Assert.assertEquals("k=\"v\"", cookieMiddleware.getValidCookiesAsString());
+
+ headersToSend = new ErrorFlightMetadata();
+ headersToSend.insert(SET_COOKIE_HEADER, "k=v; Max-Age=-2");
+ cookieMiddleware.onHeadersReceived(headersToSend);
+
+ // Verify that the k cookie was discarded because the server told the client it is expired.
+ Assert.assertTrue(cookieMiddleware.getValidCookiesAsString().isEmpty());
Review comment:
Ah! That's fun. Do you think it's worth filing a JDK bug? Though I'm surprised it's been around so long.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org