Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-10487 [FlightRPC][C++] Header-based auth in clients #8724

Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
c2ba2c7
[1] Initial commit to support client header authentication in C++
lyndonbauto Nov 18, 2020
ab7d6a3
[1] Added integration test for client header authentication in C++ an…
lyndonbauto Nov 19, 2020
ecb533f
Merge branch 'lyndon/flight-auth-redesign-cpp' of https://github.com/…
lyndonbauto Nov 19, 2020
73be3e7
[1] Updates for linting
lyndonbauto Nov 19, 2020
74ef8ea
[1] Adding missed file.
lyndonbauto Nov 19, 2020
29a3192
[1] Adding fix for Java lint errors.
lyndonbauto Nov 19, 2020
fac0bd0
[1] Added a couple comments
lyndonbauto Nov 19, 2020
7fd1279
[1] Minor comment fixes
lyndonbauto Nov 19, 2020
0b5a08e
[1] Addressed pull request comments, still need to address comments a…
lyndonbauto Nov 23, 2020
6861cf0
[1] Added unit test.
lyndonbauto Nov 23, 2020
01a134b
[1] Fixed linting issues
lyndonbauto Nov 23, 2020
de78c6b
[1] Fixing linting issues
lyndonbauto Nov 23, 2020
c44698f
[1] Removed some extra spaces at the end of some lines.
lyndonbauto Nov 23, 2020
e975fd8
[1] Correcting linting issues.
lyndonbauto Nov 24, 2020
37889fa
[1] Minor cmake fix
lyndonbauto Nov 24, 2020
e7ac27c
[1] Trying different cmake spacing.
lyndonbauto Nov 24, 2020
ba7cb9f
[1] Trying different cmake
lyndonbauto Nov 24, 2020
1426252
[1] Addressed code review comments.
lyndonbauto Nov 24, 2020
516d993
[1] Removing integration test and reverting some cmake changes.
lyndonbauto Nov 24, 2020
3000ecb
[1] Removed some no longer used functionality.
lyndonbauto Nov 24, 2020
1de10fa
[1] Added improved testing and fixed linting.
lyndonbauto Nov 24, 2020
065af4a
[1] Fixed lint issue
lyndonbauto Nov 24, 2020
d4da03b
Merge branch 'master' of https://github.com/apache/arrow into jduo/ly…
lyndonbauto Nov 25, 2020
911fcc7
[1] Updating submodule
lyndonbauto Nov 25, 2020
f41edce
[1] Minor documentation fixes.
lyndonbauto Nov 25, 2020
6b6fbbe
[1] Fixed casting issue on some builds
lyndonbauto Nov 25, 2020
199b655
[1] Added missing parameter for documentation
lyndonbauto Nov 25, 2020
47aa581
[1] Fixing cast.
lyndonbauto Nov 25, 2020
477d865
[1] Moving std:: from toupper call because it causes break in some bu…
lyndonbauto Nov 25, 2020
1cc3fdb
[1] Adding missed std remove
lyndonbauto Nov 25, 2020
d27465d
[1] Fixed linting issue.
lyndonbauto Nov 25, 2020
d21006f
[1] Updated test return error properly and to check for error
lyndonbauto Nov 25, 2020
6cd8a45
[1] Fixed linting issue.
lyndonbauto Nov 25, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions cpp/src/arrow/flight/CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -118,6 +118,7 @@ set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS_BACKUP}")
# protobuf-internal.cc
set(ARROW_FLIGHT_SRCS
client.cc
client_header_internal.cc
internal.cc
protocol_internal.cc
serialization_internal.cc
Expand Down
34 changes: 34 additions & 0 deletions cpp/src/arrow/flight/client.cc
Original file line number Diff line number Diff line change
Expand Up @@ -50,6 +50,7 @@
#include "arrow/util/uri.h"

#include "arrow/flight/client_auth.h"
#include "arrow/flight/client_header_internal.h"
#include "arrow/flight/client_middleware.h"
#include "arrow/flight/internal.h"
#include "arrow/flight/middleware.h"
Expand Down Expand Up @@ -104,6 +105,9 @@ struct ClientRpc {
std::chrono::system_clock::now() + options.timeout);
context.set_deadline(deadline);
}
for (auto header : options.headers) {
context.AddMetadata(header.first, header.second);
}
}

/// \brief Add an auth token via an auth handler
Expand Down Expand Up @@ -994,6 +998,30 @@ class FlightClient::FlightClientImpl {
return Status::OK();
}

arrow::Result<std::pair<std::string, std::string>> AuthenticateBasicToken(
const FlightCallOptions& options, const std::string& username,
const std::string& password) {
// Add basic auth headers to outgoing headers.
ClientRpc rpc(options);
internal::AddBasicAuthHeaders(&rpc.context, username, password);

std::shared_ptr<grpc::ClientReaderWriter<pb::HandshakeRequest, pb::HandshakeResponse>>
stream = stub_->Handshake(&rpc.context);
GrpcClientAuthSender outgoing{stream};
GrpcClientAuthReader incoming{stream};

// Explicitly close our side of the connection.
bool finished_writes = stream->WritesDone();
RETURN_NOT_OK(internal::FromGrpcStatus(stream->Finish(), &rpc.context));
if (!finished_writes) {
return MakeFlightError(FlightStatusCode::Internal,
"Could not finish writing before closing");
}

// Grab bearer token from incoming headers.
return internal::GetBearerTokenHeader(rpc.context);
}

Status ListFlights(const FlightCallOptions& options, const Criteria& criteria,
std::unique_ptr<FlightListing>* listing) {
pb::Criteria pb_criteria;
Expand Down Expand Up @@ -1198,6 +1226,12 @@ Status FlightClient::Authenticate(const FlightCallOptions& options,
return impl_->Authenticate(options, std::move(auth_handler));
}

arrow::Result<std::pair<std::string, std::string>> FlightClient::AuthenticateBasicToken(
const FlightCallOptions& options, const std::string& username,
const std::string& password) {
return impl_->AuthenticateBasicToken(options, username, password);
}

Status FlightClient::DoAction(const FlightCallOptions& options, const Action& action,
std::unique_ptr<ResultStream>* results) {
return impl_->DoAction(options, action, results);
Expand Down
14 changes: 14 additions & 0 deletions cpp/src/arrow/flight/client.h
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@
#include "arrow/ipc/options.h"
#include "arrow/ipc/reader.h"
#include "arrow/ipc/writer.h"
#include "arrow/result.h"
#include "arrow/status.h"
#include "arrow/util/variant.h"

Expand Down Expand Up @@ -65,6 +66,9 @@ class ARROW_FLIGHT_EXPORT FlightCallOptions {

/// \brief IPC writer options, if applicable for the call.
ipc::IpcWriteOptions write_options;

/// \brief Headers for client to add to context.
std::vector<std::pair<std::string, std::string>> headers;
};

/// \brief Indicate that the client attempted to write a message
Expand Down Expand Up @@ -191,6 +195,16 @@ class ARROW_FLIGHT_EXPORT FlightClient {
Status Authenticate(const FlightCallOptions& options,
std::unique_ptr<ClientAuthHandler> auth_handler);

/// \brief Authenticate to the server using basic HTTP style authentication.
/// \param[in] options Per-RPC options
/// \param[in] username Username to use
/// \param[in] password Password to use
/// \return Arrow result with bearer token and status OK if client authenticated
/// sucessfully
arrow::Result<std::pair<std::string, std::string>> AuthenticateBasicToken(
const FlightCallOptions& options, const std::string& username,
const std::string& password);

/// \brief Perform the indicated action, returning an iterator to the stream
/// of results, if any
/// \param[in] options Per-RPC options
Expand Down
92 changes: 92 additions & 0 deletions cpp/src/arrow/flight/client_header_internal.cc
Original file line number Diff line number Diff line change
@@ -0,0 +1,92 @@
// Licensed to the Apache Software Foundation (ASF) under one
// or more contributor license agreements. See the NOTICE file
// distributed with this work for additional information
// regarding copyright ownership. The ASF licenses this file
// to you under the Apache License, Version 2.0 (the
// "License"); you may not use this file except in compliance
// with the License. You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing,
// software distributed under the License is distributed on an
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
// KIND, either express or implied. See the License for the
// specific language governing permissions and limitations
// under the License.

// Interfaces for defining middleware for Flight clients. Currently
// experimental.

#include "arrow/flight/client_header_internal.h"
#include "arrow/flight/client.h"
#include "arrow/flight/client_auth.h"
#include "arrow/util/base64.h"
#include "arrow/util/make_unique.h"

#include <algorithm>
#include <cctype>
#include <memory>
#include <string>

const char kAuthHeader[] = "authorization";
const char kBearerPrefix[] = "Bearer ";
const char kBasicPrefix[] = "Basic ";

namespace arrow {
namespace flight {
namespace internal {

/// \brief Add base64 encoded credentials to the outbound headers.
///
/// \param context Context object to add the headers to.
/// \param username Username to format and encode.
/// \param password Password to format and encode.
void AddBasicAuthHeaders(grpc::ClientContext* context, const std::string& username,
const std::string& password) {
const std::string credentials = username + ":" + password;
context->AddMetadata(
kAuthHeader,
kBasicPrefix + arrow::util::base64_encode(
reinterpret_cast<const unsigned char*>(credentials.c_str()),
static_cast<unsigned int>(credentials.size())));
}

/// \brief Get bearer token from inbound headers.
///
/// \param context Incoming ClientContext that contains headers.
/// \return Arrow result with bearer token (empty if no bearer token found).
arrow::Result<std::pair<std::string, std::string>> GetBearerTokenHeader(
grpc::ClientContext& context) {
// Lambda function to compare characters without case sensitivity.
auto char_compare = [](const char& char1, const char& char2) {
return (::toupper(char1) == ::toupper(char2));
};

// Get the auth token if it exists, this can be in the initial or the trailing metadata.
auto trailing_headers = context.GetServerTrailingMetadata();
auto initial_headers = context.GetServerInitialMetadata();
auto bearer_iter = trailing_headers.find(kAuthHeader);
if (bearer_iter == trailing_headers.end()) {
bearer_iter = initial_headers.find(kAuthHeader);
if (bearer_iter == initial_headers.end()) {
return std::make_pair("", "");
}
}

// Check if the value of the auth token starts with the bearer prefix and latch it.
std::string bearer_val(bearer_iter->second.data(), bearer_iter->second.size());
if (bearer_val.size() > strlen(kBearerPrefix)) {
if (std::equal(bearer_val.begin(), bearer_val.begin() + strlen(kBearerPrefix),
kBearerPrefix, char_compare)) {
return std::make_pair(kAuthHeader, bearer_val);
}
}

// The server is not required to provide a bearer token.
return std::make_pair("", "");
}

} // namespace internal
} // namespace flight
} // namespace arrow
57 changes: 57 additions & 0 deletions cpp/src/arrow/flight/client_header_internal.h
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
// Licensed to the Apache Software Foundation (ASF) under one
// or more contributor license agreements. See the NOTICE file
// distributed with this work for additional information
// regarding copyright ownership. The ASF licenses this file
// to you under the Apache License, Version 2.0 (the
// "License"); you may not use this file except in compliance
// with the License. You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing,
// software distributed under the License is distributed on an
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
// KIND, either express or implied. See the License for the
// specific language governing permissions and limitations
// under the License.

// Interfaces for defining middleware for Flight clients. Currently
// experimental.

#pragma once

#include "arrow/flight/client_middleware.h"
#include "arrow/result.h"

#ifdef GRPCPP_PP_INCLUDE
#include <grpcpp/grpcpp.h>
#if defined(GRPC_NAMESPACE_FOR_TLS_CREDENTIALS_OPTIONS)
#include <grpcpp/security/tls_credentials_options.h>
#endif
#else
#include <grpc++/grpc++.h>
#endif

namespace arrow {
namespace flight {
namespace internal {

/// \brief Add basic authentication header key value pair to context.
///
/// \param context grpc context variable to add header to.
/// \param username username to encode into header.
/// \param password password to to encode into header.
void ARROW_FLIGHT_EXPORT AddBasicAuthHeaders(grpc::ClientContext* context,
const std::string& username,
const std::string& password);

/// \brief Get bearer token from incoming headers.
///
/// \param context context that contains headers which hold the bearer token.
/// \return Bearer token, parsed from headers, empty if one is not present.
arrow::Result<std::pair<std::string, std::string>> ARROW_FLIGHT_EXPORT
GetBearerTokenHeader(grpc::ClientContext& context);

} // namespace internal
} // namespace flight
} // namespace arrow
Loading